-- Logs begin at Tue 2022-08-23 15:31:50 UTC, end at Tue 2022-08-23 16:39:04 UTC. -- Aug 23 16:10:51.358764 dv-osbrick-836056-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 23 16:10:51.367406 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 23 16:10:51.369422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 16:10:51 2022] *** Aug 23 16:10:51.369422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 16:10:51.369422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 16:10:51.369422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: nodename: dv-osbrick-836056-3-iscsi Aug 23 16:10:51.369422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: machine: x86_64 Aug 23 16:10:51.369422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: clock source: unix Aug 23 16:10:51.369422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: pcre jit disabled Aug 23 16:10:51.369422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: detected number of CPU cores: 4 Aug 23 16:10:51.369422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: current working directory: / Aug 23 16:10:51.369422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: detected binary path: /usr/bin/uwsgi-core Aug 23 16:10:51.369422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: your processes number limit is 47680 Aug 23 16:10:51.369422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: your memory page size is 4096 bytes Aug 23 16:10:51.370227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: detected max file descriptor number: 2048 Aug 23 16:10:51.370227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: lock engine: pthread robust mutexes Aug 23 16:10:51.370227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: thunder lock: enabled Aug 23 16:10:51.370227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 23 16:10:51.370227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 16:10:51.409650 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: Python main interpreter initialized at 0x55d8f1e779c0 Aug 23 16:10:51.409650 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: python threads support enabled Aug 23 16:10:51.409650 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: your server socket listen backlog is limited to 100 connections Aug 23 16:10:51.409650 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: your mercy for graceful operations on workers is 90 seconds Aug 23 16:10:51.410016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 16:10:51.410122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: *** Operational MODE: preforking *** Aug 23 16:10:51.410358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: *** uWSGI is running in multiple interpreter mode *** Aug 23 16:10:51.410358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: spawned uWSGI master process (pid: 81590) Aug 23 16:10:51.410557 dv-osbrick-836056-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 23 16:10:51.411623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: spawned uWSGI worker 1 (pid: 81603, cores: 1) Aug 23 16:10:51.411623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: spawned uWSGI worker 2 (pid: 81604, cores: 1) Aug 23 16:10:51.411623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81590]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 16:10:55.756098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:10:55.756098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: from cryptography.utils import int_from_bytes Aug 23 16:10:55.756902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:10:55.756902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: from cryptography.utils import int_from_bytes Aug 23 16:10:55.757040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:10:55.757040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: from cryptography.utils import int_from_bytes Aug 23 16:10:55.757040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:10:55.757040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: from cryptography.utils import int_from_bytes Aug 23 16:10:55.808324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 16:10:55.808520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 16:10:55.808612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 16:10:55.808699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 16:10:55.808779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] command line args: [] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 16:10:55.808856 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] command line args: [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 16:10:55.808957 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 16:10:55.809037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 16:10:55.809140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ================================================================================ {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 16:10:55.809225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ================================================================================ {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 16:10:55.809404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] admin_token = **** {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.809493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] admin_token = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.809645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] config_dir = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.809723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] config_dir = [] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.809829 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.809914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.810012 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] config_source = [] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.810134 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] config_source = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.810215 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] debug = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.810285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] debug = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.810394 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.810638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.810736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.810796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.810930 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.811041 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.811168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.811283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.811410 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.811523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.811620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.811719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] list_limit = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.811814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] log_config_append = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.811925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] log_config_append = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.812026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.812126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.812220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] log_dir = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.812312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] log_dir = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.812417 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] log_file = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.812523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] log_file = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.812619 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.812738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.812812 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.812917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.813034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.813119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.813196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.813320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.813396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.813512 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.813595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.813672 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.813789 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.813868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.813985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.814103 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.814218 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.814298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.814450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.814572 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.814680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.814763 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.814909 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.814989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.815150 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.815239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.815390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.815529 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.815661 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.815740 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.816144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.816228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.816309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] publish_errors = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.816427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] publish_errors = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.816540 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.816623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.816765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.816848 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.816976 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.817064 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.817187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.817280 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.817399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.817477 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.817627 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] standard_threads = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.817706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] standard_threads = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.817853 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.817932 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.818114 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.818207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.818281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.818356 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.818477 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] use_journal = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.818551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] use_journal = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.818627 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] use_json = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.818699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] use_json = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.818769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] use_stderr = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.818844 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] use_stderr = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.818922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] use_syslog = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.818999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] use_syslog = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.819145 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.819223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:10:55.819395 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.819478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.819629 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.819713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.819883 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.819960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.820117 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.820193 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.820363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.820441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.820597 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.820680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.821362 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.821471 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.821596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.821771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.821850 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.822113 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.822307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.822389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.822494 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.822580 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.822747 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.822828 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.822986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.823118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.823253 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.823385 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.823510 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.823635 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.823758 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.823898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.824030 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.824160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.824290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.824414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.824537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.824664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.824866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.824992 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.825115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.825238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.825369 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.825502 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.825630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.825763 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.825890 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.826014 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.826156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.826294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.826417 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.826541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.826670 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.826792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.826919 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.827049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.827177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.827307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.827439 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.827570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.827692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.827824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.827948 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.828075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.828203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.828326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.828448 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.828577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.828703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.828830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.828953 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.829085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.829206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.829336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.829459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.829581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.829705 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.829826 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.829950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.830125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.830248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.830374 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.830497 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.830619 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.830743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.830952 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.831077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.831201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.831329 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.831452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.831576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.831705 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.831831 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.831954 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.832077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.832198 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.832339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.832426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.832499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.832574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.832681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.832783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.832880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.832984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.833080 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.833173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.833267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.833365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.833465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.833585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.833686 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.833805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.833915 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.833990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.834087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.834208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.834293 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.834372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.834444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.834559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.834646 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.834719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.834840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.834913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.834992 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.834992 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.835125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.835125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.835272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.835344 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.835414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.835485 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.835549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.835614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.835690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.835690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.835813 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.835883 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.835959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.836031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.836103 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.836237 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.836316 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.837037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.837308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.837397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.837484 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.837557 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.837744 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.837827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.837985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.838095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.838255 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.838388 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.838505 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.838640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.838774 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.838903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.839034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.839114 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.839191 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.839264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.839419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.839498 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.839656 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.839736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.839887 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.839964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.840121 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.840201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.840380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.840505 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.840618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.840695 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.840854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.840931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.841089 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.841175 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.841325 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.841402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.841555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.841632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.841780 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.841854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.842006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.842103 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.842258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.842349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.842488 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.842576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.842714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.842798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.842947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.843026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.843176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.843264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.843414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.843493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.843646 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.843725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.843892 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.843979 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.844125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.844204 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.844378 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.844456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.844610 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] auth.external = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.844700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.844844 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.844923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.845078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.external = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.845156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.845307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.845421 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.845584 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] auth.password = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.845671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.845817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] auth.token = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.845896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.846043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.password = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.846176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.846293 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.token = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.846385 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.846530 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.846610 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.846762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.846847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.847006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.847093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.847231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.847309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.847464 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.847545 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.847699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] credential.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.847785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.847922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.848006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.848154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.848233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.848396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.848486 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.848641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.848720 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.848883 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.848966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.849118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.849226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.849360 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.849448 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.849587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.849678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.849833 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.849938 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.850099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.850249 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.850381 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.850506 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.850634 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.850773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.850898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.851024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.851149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.851285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.851410 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.851544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.851668 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.851796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] federation.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.851921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.852046 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.852169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.852300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.852424 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.852546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.852672 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.852798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.852918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.853066 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.853191 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.853316 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.853440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.853564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.853696 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.853822 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.853947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.854085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.854208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.854334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.854467 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.854592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.854732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.854857 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.854981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.855104 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.855235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.855362 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.855485 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.855607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.855731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.855866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.856069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.856196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.856322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.856445 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.856580 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.856705 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.856836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.856963 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.857114 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.857243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.857370 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.857493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.857624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.857765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.857889 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.858021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.858194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.858330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.858330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.858576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.858701 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.858831 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.858956 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.859083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.859214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.859338 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.859462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.859586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.859709 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.859833 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.859977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.860104 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.860233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.860357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.860480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.860604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.860734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.860860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.860984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.861114 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.861238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.861361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.861493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.861618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.861751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.861875 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.861998 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.862141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.862276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.862402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.862527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.862651 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.862774 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.862898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.863031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.863109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.863182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.863253 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.863324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.863403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.863476 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.863547 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.863618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.863688 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.863759 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.863837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.863911 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.864022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.864119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.864119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.864299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.864299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.864438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.864509 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.864579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.864649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.864725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.864804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.864877 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.864947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.865018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.865088 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.865158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.865260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.865342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.865511 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.865590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.865756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.865835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.865992 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.866100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.866249 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.866329 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.866482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.866561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.866710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.866792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.866947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.867026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.867204 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.867283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.867432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.867513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.867714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.867843 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.868108 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.868187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.868350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.868557 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.868649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.868800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.868880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.869035 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.869123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.869272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.869351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.869504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.869582 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.869738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.869830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.869967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.870046 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.870245 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.870325 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.870492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.870584 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.870738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.870817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.870970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.871048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.871215 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.871302 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.871445 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.871524 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.871680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.871758 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.871910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.871997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.872143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.872222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.872375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.872454 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.872607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.872694 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.872849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.872927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.873092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.873222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.873346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.873476 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.873600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.873723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.873846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.873978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.874125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.874261 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.874261 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.874502 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.874502 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.874732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.874856 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.874986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.875109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.875233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.875356 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.875478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.875600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.875740 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] resource.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.875866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.875988 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.876111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.876234 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.876356 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.876495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.876619 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.876742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.876865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.876988 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.877110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.877241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.877364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.877497 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.877620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.877742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.877871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.878004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.878175 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.878304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] role.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.878427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.878553 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] role.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.878755 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] role.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.878883 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.879009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] role.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.879133 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.879257 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.879391 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.879524 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.879650 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.879773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.879899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.880023 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.880147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.880278 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.880404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.880528 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.880652 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.880776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.880899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.881039 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.881167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.881291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.881416 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.881539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.881663 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.881795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.881921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.882044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.882189 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.882267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.882267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.882408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.882408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.882535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.882606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.882677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.882748 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.882826 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.882899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.882970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.883041 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.883161 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.883742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.883826 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.883826 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.884008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.884008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.884179 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.884269 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.884508 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.884586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.884748 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.884826 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.884979 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.885066 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.885210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.885290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.885439 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.885517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.885686 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.885781 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.885939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.886018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.886207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.886288 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.886442 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.886533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.886676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.886756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] token.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.886903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.886987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.887137 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] token.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.887224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.887370 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.887449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.887613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.887691 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.887846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.887933 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.888086 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.888164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.888328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.888406 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.888560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.888646 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.888800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.888879 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.889036 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.889113 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.889277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.889364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.889509 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.889586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.889742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.889820 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.889972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.890059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.890236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.890315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.890479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.890557 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.890703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.890792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.890941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.891021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] database.connection = **** {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.891225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.891314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.891481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] database.connection = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.891570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.891719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.891815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.891961 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.892044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.892194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.892274 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.892429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.892507 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.892658 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.892737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.892890 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.892970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.893121 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.893244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.893352 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.893433 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.893591 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.893671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.893824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.893902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.894107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.894192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.894312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.894391 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.894556 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.894634 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.894786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.894866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.895025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.895102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.895249 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.895332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.895414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 16:10:55.895486 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.895703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:10:55.895871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 16:10:55.926051 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:55.926229 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:55.926311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:55.926385 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:55.926536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:55.926622 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:55.935221 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:55.935357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:55.964429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:55.964660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:55.964751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:55.964980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.018820 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.018960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.067984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.068220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.068359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.068599 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.226032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.226288 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.226513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.226696 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.226784 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.226931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.227016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.227286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.227497 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.227834 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.228155 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.228377 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.250935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.251111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.251204 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.251343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.251422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.251514 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.251592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.251731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.251814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.251945 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.252027 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.252157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.252241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.252370 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.263487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.263841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.277111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.277225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.277303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.277370 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.277511 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.277606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.277738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.277820 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.277958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.278040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.278202 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.278297 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.278418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.278502 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81604) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 16:10:56.295722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.295825 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.295971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 16:10:56.296054 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 16:10:56.296261 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.296353 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.296444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 16:10:56.296519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 16:10:56.296720 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.296803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.296979 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.297061 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.297237 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.297327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.297748 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.297829 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.307837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.308067 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.308151 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.308345 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.308429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.308615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.308697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.308898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.315591 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.315902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.318485 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.318774 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.318855 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.319059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.319150 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.319340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.319422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.319622 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.319702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.319885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.319968 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.320142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.320220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.320408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.320497 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.320679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.320842 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.321194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.321396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.321490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.321824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.322118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.344501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.345429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.345954 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.346265 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.346909 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.347192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.350909 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.351197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.351482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.351842 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.352361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.352829 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.357918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.358232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.359136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.359420 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.362307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.362603 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.362888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.363170 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.363445 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.363527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.363719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.363801 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.363991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.364073 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.364262 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.364344 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.364530 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.364804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.365072 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.365338 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.381485 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.381778 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.382676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.382970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.386275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.387631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.389478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.389778 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.390834 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.391129 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.393990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.395287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.397135 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.398406 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.400514 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.400814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.401102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.401391 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.401679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.401972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.402054 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.402341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.402627 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.402910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.403186 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.403474 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.418779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.419070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.419340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.419604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.420596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.420883 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.421154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.421417 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.426472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.427982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.428241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.428322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.429730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.430008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.431546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.431834 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.432131 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.432421 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.432697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.433496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.433782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.434099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.434388 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.434667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.443968 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.444259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.444543 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.444825 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.445108 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.445386 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.445673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.445921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.446460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.446789 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.447071 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.447353 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.447631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.447927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.461058 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.463543 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.464292 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.466579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.467318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.468922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.470472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.470830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.471194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.473730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.475176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.476641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.476924 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.477896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.478439 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.479901 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.483060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.483356 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.483649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.483937 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.484503 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.485945 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.489607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.489897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.490206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.490489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.491860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.492153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.492438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.499210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.499497 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.499779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.499946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81604) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.500234 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.500520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.500798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.501072 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.501345 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.501621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.501908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.502215 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.502495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.502769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.503032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.503313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.503584 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81604) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.506668 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 16:10:56.506951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.507234 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.507512 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.507784 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.508063 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.509295 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.509586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.509870 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.510173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.510447 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.510710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.510987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.511256 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 16:10:56.537811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d8f1e779c0 pid: 81604 (default app) Aug 23 16:10:56.541936 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0ef6d-2852-4fca-8b0b-e6529a575bd2 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:10:56.542247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0ef6d-2852-4fca-8b0b-e6529a575bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:10:56.542526 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0ef6d-2852-4fca-8b0b-e6529a575bd2 None None] PATH_INFO: `/v3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:10:56.546363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d8f1e779c0 pid: 81603 (default app) Aug 23 16:10:56.546714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Tue Aug 23 16:10:56 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:03.203342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456abd10-bff3-40ad-9d0a-87ce51908a34 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:03.203766 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456abd10-bff3-40ad-9d0a-87ce51908a34 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:03.203901 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456abd10-bff3-40ad-9d0a-87ce51908a34 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:03.208228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:11:03.215712 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037ba26-c236-4a76-9e00-09ed56fabd2d None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:03.216106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037ba26-c236-4a76-9e00-09ed56fabd2d None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:03.216335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037ba26-c236-4a76-9e00-09ed56fabd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:03.287150 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: INFO dbcounter [None req-3037ba26-c236-4a76-9e00-09ed56fabd2d None None] Registered counter for database keystone Aug 23 16:11:03.305808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG oslo_db.sqlalchemy.engines [None req-3037ba26-c236-4a76-9e00-09ed56fabd2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:11:03.312335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writer thread running {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:11:03.488824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG passlib.handlers.bcrypt [None req-3037ba26-c236-4a76-9e00-09ed56fabd2d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81604) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 16:11:03.489154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG passlib.handlers.bcrypt [None req-3037ba26-c236-4a76-9e00-09ed56fabd2d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81604) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 16:11:03.544075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-3037ba26-c236-4a76-9e00-09ed56fabd2d None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:03.545684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-3037ba26-c236-4a76-9e00-09ed56fabd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:03.675189 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 16:11:04.129854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456abd10-bff3-40ad-9d0a-87ce51908a34 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:04.200908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: INFO dbcounter [None req-456abd10-bff3-40ad-9d0a-87ce51908a34 None None] Registered counter for database keystone Aug 23 16:11:04.222962 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG oslo_db.sqlalchemy.engines [None req-456abd10-bff3-40ad-9d0a-87ce51908a34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:11:04.229684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writer thread running {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:11:04.347692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456abd10-bff3-40ad-9d0a-87ce51908a34 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:04.351959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa2505-426b-4ec0-8a62-ae4d93774c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:04.352579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa2505-426b-4ec0-8a62-ae4d93774c98 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:04.352860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa2505-426b-4ec0-8a62-ae4d93774c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:04.353221 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa2505-426b-4ec0-8a62-ae4d93774c98 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:04.361717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa2505-426b-4ec0-8a62-ae4d93774c98 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:04.412705 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: WARNING keystone.common.rbac_enforcer.enforcer [None req-98fa2505-426b-4ec0-8a62-ae4d93774c98 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 16:11:04.412992 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa2505-426b-4ec0-8a62-ae4d93774c98 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:04.423073 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Tue Aug 23 16:11:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:11:04.428969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037ba26-c236-4a76-9e00-09ed56fabd2d None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:04.443391 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037ba26-c236-4a76-9e00-09ed56fabd2d None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:04.447884 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88f5ed-b599-4474-ad52-e740a7d74094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:04.448998 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88f5ed-b599-4474-ad52-e740a7d74094 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:04.449282 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88f5ed-b599-4474-ad52-e740a7d74094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:04.449554 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88f5ed-b599-4474-ad52-e740a7d74094 admin admin] PATH_INFO: `/v3/projects/062779fbe176490e8964d5f2d8d34b76` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:04.451138 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88f5ed-b599-4474-ad52-e740a7d74094 admin admin] RBAC: Authorizing `identity:get_project(project_id=062779fbe176490e8964d5f2d8d34b76)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:04.503062 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ca88f5ed-b599-4474-ad52-e740a7d74094 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 16:11:04.503405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88f5ed-b599-4474-ad52-e740a7d74094 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:04.507925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Tue Aug 23 16:11:04 2022] GET /identity/v3/projects/062779fbe176490e8964d5f2d8d34b76 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:06.392205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba902a74-5697-43b5-8ae4-18c6efdaf26d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:06.392742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba902a74-5697-43b5-8ae4-18c6efdaf26d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:06.392742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba902a74-5697-43b5-8ae4-18c6efdaf26d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:06.396867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:11:06.402985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024a3f1-1353-4e94-8c1f-0d55bf58e1be None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:06.403417 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024a3f1-1353-4e94-8c1f-0d55bf58e1be None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:06.403537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024a3f1-1353-4e94-8c1f-0d55bf58e1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:06.423298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-9024a3f1-1353-4e94-8c1f-0d55bf58e1be None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:06.424797 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9024a3f1-1353-4e94-8c1f-0d55bf58e1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:06.432618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 16:11:06.703846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba902a74-5697-43b5-8ae4-18c6efdaf26d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:06.716427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba902a74-5697-43b5-8ae4-18c6efdaf26d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:06.720605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72454aba-e617-41d3-a477-0551e2f51de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:06.721202 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72454aba-e617-41d3-a477-0551e2f51de0 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:06.721484 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72454aba-e617-41d3-a477-0551e2f51de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:06.721760 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72454aba-e617-41d3-a477-0551e2f51de0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:06.730035 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72454aba-e617-41d3-a477-0551e2f51de0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:06.731821 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72454aba-e617-41d3-a477-0551e2f51de0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:06.740545 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Tue Aug 23 16:11:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:11:06.745897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024a3f1-1353-4e94-8c1f-0d55bf58e1be None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:06.754984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024a3f1-1353-4e94-8c1f-0d55bf58e1be None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:06.759279 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3bf78-8b08-4e50-8c59-0fdb6a435173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:06.760198 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3bf78-8b08-4e50-8c59-0fdb6a435173 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:06.760490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3bf78-8b08-4e50-8c59-0fdb6a435173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:06.760768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3bf78-8b08-4e50-8c59-0fdb6a435173 admin admin] PATH_INFO: `/v3/users/307f76b84605446ea643922d0a93ba9f` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:06.762152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3bf78-8b08-4e50-8c59-0fdb6a435173 admin admin] RBAC: Authorizing `identity:get_user(user_id=307f76b84605446ea643922d0a93ba9f)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:06.763938 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3bf78-8b08-4e50-8c59-0fdb6a435173 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:06.765449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Tue Aug 23 16:11:06 2022] GET /identity/v3/users/307f76b84605446ea643922d0a93ba9f => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:08.750024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2d422-f057-4b2a-90e3-734123c9767d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:08.750609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2d422-f057-4b2a-90e3-734123c9767d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:08.750609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2d422-f057-4b2a-90e3-734123c9767d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:08.751941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:08.757172 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a8cdd-d9aa-4cc3-8e6f-6d364ac6cd79 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:08.757559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a8cdd-d9aa-4cc3-8e6f-6d364ac6cd79 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:08.757720 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a8cdd-d9aa-4cc3-8e6f-6d364ac6cd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:08.776602 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-817a8cdd-d9aa-4cc3-8e6f-6d364ac6cd79 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:08.777772 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-817a8cdd-d9aa-4cc3-8e6f-6d364ac6cd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:08.789232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f8b02-0e9b-43c9-bc58-485aef0c21a4 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:08.789521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f8b02-0e9b-43c9-bc58-485aef0c21a4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:08.789801 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f8b02-0e9b-43c9-bc58-485aef0c21a4 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:08.792185 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:11:08.798692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aac2bc-083a-4b8e-9f18-4cec5a82b575 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:08.798980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aac2bc-083a-4b8e-9f18-4cec5a82b575 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:08.799267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aac2bc-083a-4b8e-9f18-4cec5a82b575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:08.842706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG passlib.handlers.bcrypt [None req-05aac2bc-083a-4b8e-9f18-4cec5a82b575 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81603) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 16:11:08.843140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG passlib.handlers.bcrypt [None req-05aac2bc-083a-4b8e-9f18-4cec5a82b575 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81603) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 16:11:08.861583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:08.888701 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-05aac2bc-083a-4b8e-9f18-4cec5a82b575 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:08.890406 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-05aac2bc-083a-4b8e-9f18-4cec5a82b575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:08.989475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:11:09.125731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a8cdd-d9aa-4cc3-8e6f-6d364ac6cd79 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:09.149813 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:09.239788 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a8cdd-d9aa-4cc3-8e6f-6d364ac6cd79 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:09.258720 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aac2bc-083a-4b8e-9f18-4cec5a82b575 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:09.273448 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a9272-582e-4d1b-901d-aed72cec6809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:09.274093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a9272-582e-4d1b-901d-aed72cec6809 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:09.274383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a9272-582e-4d1b-901d-aed72cec6809 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:09.274653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a9272-582e-4d1b-901d-aed72cec6809 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:09.287704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a9272-582e-4d1b-901d-aed72cec6809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:09.296586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-948a9272-582e-4d1b-901d-aed72cec6809 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:09.296586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:09.296586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:09.296586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:09.296586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:09.296586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:09.296586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:09.296586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:09.296586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:09.296586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:09.296586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:09.296586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:09.296586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:09.296586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:09.296586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:09.296586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:09.297463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:09.297463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:09.297463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:09.297463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:09.297463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:09.297463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:09.297463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:09.297463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:09.297463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:09.297463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:09.297463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:09.297463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:09.297463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:09.297463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:09.297463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:09.297463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:09.298348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:09.298348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:09.298348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:09.298348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:09.298348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:09.298348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:09.298348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:09.298348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:09.298348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:09.298348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:09.298348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:09.298348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:11:09.298348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:11:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:09.303687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a9272-582e-4d1b-901d-aed72cec6809 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:09.363953 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aac2bc-083a-4b8e-9f18-4cec5a82b575 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:09.366240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:09.388089 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:09.402501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3010fc3-31dd-4366-8623-704dcf27ef10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:09.403355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3010fc3-31dd-4366-8623-704dcf27ef10 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:09.403644 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3010fc3-31dd-4366-8623-704dcf27ef10 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:09.403916 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3010fc3-31dd-4366-8623-704dcf27ef10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:09.406728 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a9272-582e-4d1b-901d-aed72cec6809 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:09.441968 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494acfcc-9d96-49d9-aae6-dbe91404c41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:09.442603 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494acfcc-9d96-49d9-aae6-dbe91404c41a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:09.442887 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494acfcc-9d96-49d9-aae6-dbe91404c41a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:09.443166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494acfcc-9d96-49d9-aae6-dbe91404c41a None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:09.443840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494acfcc-9d96-49d9-aae6-dbe91404c41a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:09.444146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494acfcc-9d96-49d9-aae6-dbe91404c41a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:09.445554 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494acfcc-9d96-49d9-aae6-dbe91404c41a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:09.457387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:09.463464 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494acfcc-9d96-49d9-aae6-dbe91404c41a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:09.471560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3010fc3-31dd-4366-8623-704dcf27ef10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:09.473072 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3010fc3-31dd-4366-8623-704dcf27ef10 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:09.562524 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494acfcc-9d96-49d9-aae6-dbe91404c41a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:09.568885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 16:11:09.575079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3010fc3-31dd-4366-8623-704dcf27ef10 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:09.577789 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:09.597661 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b76b3-8a6b-4d03-ac47-bec2262a07aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:09.598338 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b76b3-8a6b-4d03-ac47-bec2262a07aa None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:09.598628 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b76b3-8a6b-4d03-ac47-bec2262a07aa None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:09.598906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b76b3-8a6b-4d03-ac47-bec2262a07aa None admin] PATH_INFO: `/v3/users/307f76b84605446ea643922d0a93ba9f` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:09.600785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b76b3-8a6b-4d03-ac47-bec2262a07aa None admin] RBAC: Authorizing `identity:get_user(user_id=307f76b84605446ea643922d0a93ba9f)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:09.603129 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b76b3-8a6b-4d03-ac47-bec2262a07aa None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:09.605558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:09 2022] GET /identity/v3/users/307f76b84605446ea643922d0a93ba9f => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:09.611527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b76b3-8a6b-4d03-ac47-bec2262a07aa None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:09.626590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:09.680827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3010fc3-31dd-4366-8623-704dcf27ef10 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:09.713269 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b76b3-8a6b-4d03-ac47-bec2262a07aa None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:09.714934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a4eb7-91dc-4969-9e4e-6c41978d45e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:09.715797 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a4eb7-91dc-4969-9e4e-6c41978d45e0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:09.716445 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a4eb7-91dc-4969-9e4e-6c41978d45e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:09.716732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a4eb7-91dc-4969-9e4e-6c41978d45e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:09.735340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a4eb7-91dc-4969-9e4e-6c41978d45e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:09.736804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a4eb7-91dc-4969-9e4e-6c41978d45e0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:09.747264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff528d1-329d-4b4d-942b-849d067da78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:09.747907 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff528d1-329d-4b4d-942b-849d067da78a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:09.748190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff528d1-329d-4b4d-942b-849d067da78a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:09.748467 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff528d1-329d-4b4d-942b-849d067da78a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:09.749592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff528d1-329d-4b4d-942b-849d067da78a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:09.751094 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff528d1-329d-4b4d-942b-849d067da78a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:09.752681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:09.755532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-8f3a4eb7-91dc-4969-9e4e-6c41978d45e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:11:09.755532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:09.755532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:09.755532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:09.755532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:09.755532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:09.755532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:09.755532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:09.755532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:09.755532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:09.755532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:09.755532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:09.755532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:11:09.755532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:11:09.755532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:11:09.755532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:11:09.756863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:09.756863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:09.756863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:09.756863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:09.756863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:09.756863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:09.756863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:09.756863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:09.756863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:09.756863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:09.756863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:09.756863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:09.756863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:09.756863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:09.756863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:09.756863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:09.756863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:11:09.758115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:11:09.758115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:11:09.758115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:09.758115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:11:09.763573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff528d1-329d-4b4d-942b-849d067da78a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:09.763992 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a4eb7-91dc-4969-9e4e-6c41978d45e0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:09.819188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:09.844826 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:09.864258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a4eb7-91dc-4969-9e4e-6c41978d45e0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:09.864858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff528d1-329d-4b4d-942b-849d067da78a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:09.898204 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80f78f-a864-4e21-b0d7-3667d856f615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:09.898367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffb360-6649-4e52-ba4a-caec2fa36f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:09.898809 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80f78f-a864-4e21-b0d7-3667d856f615 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:09.898904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffb360-6649-4e52-ba4a-caec2fa36f7e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:09.899089 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80f78f-a864-4e21-b0d7-3667d856f615 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:09.899175 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffb360-6649-4e52-ba4a-caec2fa36f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:09.899357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80f78f-a864-4e21-b0d7-3667d856f615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:09.899448 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffb360-6649-4e52-ba4a-caec2fa36f7e None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:09.900043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffb360-6649-4e52-ba4a-caec2fa36f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:09.900281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d80f78f-a864-4e21-b0d7-3667d856f615 None admin] RBAC: Adding query filter params (role.id=8de0c87242d7426ea25a510b578c02aa, scope.domain.id=default, user.id=307f76b84605446ea643922d0a93ba9f) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:09.900408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffb360-6649-4e52-ba4a-caec2fa36f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:09.900562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d80f78f-a864-4e21-b0d7-3667d856f615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:09.901856 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffb360-6649-4e52-ba4a-caec2fa36f7e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:09.901958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d80f78f-a864-4e21-b0d7-3667d856f615 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:09.908848 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Tue Aug 23 16:11:09 2022] GET /identity/v3/role_assignments?user.id=307f76b84605446ea643922d0a93ba9f&scope.domain.id=default&role.id=8de0c87242d7426ea25a510b578c02aa => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:09.922473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:12.129132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839e2d7-4a7b-4ad1-9dcb-e0e1149acbf9 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:12.130187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839e2d7-4a7b-4ad1-9dcb-e0e1149acbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:12.130708 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839e2d7-4a7b-4ad1-9dcb-e0e1149acbf9 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:12.132266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:12.138711 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc512faa-6150-42aa-aec6-77f111774eb6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:12.139168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc512faa-6150-42aa-aec6-77f111774eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:12.139267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc512faa-6150-42aa-aec6-77f111774eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:12.168304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fc512faa-6150-42aa-aec6-77f111774eb6 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:12.169790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fc512faa-6150-42aa-aec6-77f111774eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:12.267400 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:12.271923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21cd25-3501-47ea-83ea-100f32bc0b85 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:12.272442 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21cd25-3501-47ea-83ea-100f32bc0b85 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:12.272943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21cd25-3501-47ea-83ea-100f32bc0b85 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:12.274747 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:12.279820 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c19d16-fadf-4fbb-ae90-a5c03996873b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:12.280113 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c19d16-fadf-4fbb-ae90-a5c03996873b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:12.280394 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c19d16-fadf-4fbb-ae90-a5c03996873b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:12.308654 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-57c19d16-fadf-4fbb-ae90-a5c03996873b None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:12.309852 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-57c19d16-fadf-4fbb-ae90-a5c03996873b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:12.370471 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:12.399567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 12/25] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:12.423199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f71cf6-4957-45f5-99b5-1a26477e6a44 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:12.423824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f71cf6-4957-45f5-99b5-1a26477e6a44 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:12.424309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f71cf6-4957-45f5-99b5-1a26477e6a44 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:12.427111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 14/26] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:12.432514 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c24b5-f251-461d-a0f8-a3d33923c8d1 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:12.432809 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c24b5-f251-461d-a0f8-a3d33923c8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:12.433089 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c24b5-f251-461d-a0f8-a3d33923c8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:12.462120 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8a2c24b5-f251-461d-a0f8-a3d33923c8d1 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:12.464313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8a2c24b5-f251-461d-a0f8-a3d33923c8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:12.555736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 13/27] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:12.643800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f71cf6-4957-45f5-99b5-1a26477e6a44 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:12.763925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620499a7-9caf-430d-b6ed-5f59175d428d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:12.764539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620499a7-9caf-430d-b6ed-5f59175d428d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:12.765005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620499a7-9caf-430d-b6ed-5f59175d428d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:12.766826 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 14/28] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:12.773679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e4b1f-ef87-48c9-8675-11a92b06f2c7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:12.774239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e4b1f-ef87-48c9-8675-11a92b06f2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:12.774832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e4b1f-ef87-48c9-8675-11a92b06f2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:12.792481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f71cf6-4957-45f5-99b5-1a26477e6a44 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:12.797452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-942e4b1f-ef87-48c9-8675-11a92b06f2c7 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:12.799917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-942e4b1f-ef87-48c9-8675-11a92b06f2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:12.871866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5499f8-055a-433d-94f5-54117640b6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:12.872512 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5499f8-055a-433d-94f5-54117640b6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:12.872796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5499f8-055a-433d-94f5-54117640b6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:12.873077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5499f8-055a-433d-94f5-54117640b6a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:12.894991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5499f8-055a-433d-94f5-54117640b6a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:12.899909 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 15/29] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:11:12.900422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-7a5499f8-055a-433d-94f5-54117640b6a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:12.900422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:12.900422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:12.900422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:12.900422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:12.900422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:12.900422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:12.900422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:12.900422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:12.900422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:12.900422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:12.900422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:12.900422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:12.900422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:12.900422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:12.900422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:12.901587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:12.901587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:12.901587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:12.901587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:12.901587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:12.901587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:12.901587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:12.901587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:12.901587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:12.901587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:12.901587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:12.901587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:12.901587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:12.901587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:12.901587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:12.901587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:12.902409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:12.902409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:12.902409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:12.902409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:12.902409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:12.902409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:12.902409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:12.902409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:12.902409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:12.902409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:12.902409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:12.902409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:11:12.902409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 15/30] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:11:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:12.911059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e4b1f-ef87-48c9-8675-11a92b06f2c7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:12.928734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5499f8-055a-433d-94f5-54117640b6a4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:12.939927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:12.958592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:13.080252 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e4b1f-ef87-48c9-8675-11a92b06f2c7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:13.102178 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5499f8-055a-433d-94f5-54117640b6a4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:13.141728 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a2567-43eb-4b10-b517-45e93b562bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:13.143819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a2567-43eb-4b10-b517-45e93b562bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:13.144108 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a2567-43eb-4b10-b517-45e93b562bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:13.144603 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a2567-43eb-4b10-b517-45e93b562bb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:13.145294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a2567-43eb-4b10-b517-45e93b562bb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:13.145606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a2567-43eb-4b10-b517-45e93b562bb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:13.149267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a2567-43eb-4b10-b517-45e93b562bb0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:13.164384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cb67a-193f-4b72-8d74-305118cfcd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:13.165138 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cb67a-193f-4b72-8d74-305118cfcd24 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:13.165413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cb67a-193f-4b72-8d74-305118cfcd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:13.165689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cb67a-193f-4b72-8d74-305118cfcd24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:13.188363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 16/31] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:13.189208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a2567-43eb-4b10-b517-45e93b562bb0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:13.194174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cb67a-193f-4b72-8d74-305118cfcd24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:13.195687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cb67a-193f-4b72-8d74-305118cfcd24 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:13.229413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-f97cb67a-193f-4b72-8d74-305118cfcd24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:11:13.229413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:13.229413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:13.229413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:13.229413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:13.229413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:13.229413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:13.229413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:13.229413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:13.229413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:13.229413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:13.229413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:13.229413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:11:13.229413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:11:13.229413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:11:13.229413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:11:13.230414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:13.230414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:13.230414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:13.230414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:13.230414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:13.230414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:13.230414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:13.230414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:13.230414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:13.230414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:13.230414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:13.230414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:13.230414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:13.230414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:13.230414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:13.230414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:13.230414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:11:13.231227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:11:13.231227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:11:13.231227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:11:13.237479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 16/32] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:11:13.238375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cb67a-193f-4b72-8d74-305118cfcd24 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:13.302484 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:13.309527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:13.314294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a2567-43eb-4b10-b517-45e93b562bb0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:13.351321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7cbf2-4873-49f1-84eb-44e1a42ebb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:13.351506 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cb67a-193f-4b72-8d74-305118cfcd24 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:13.352314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7cbf2-4873-49f1-84eb-44e1a42ebb2f None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:13.352741 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7cbf2-4873-49f1-84eb-44e1a42ebb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:13.353218 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7cbf2-4873-49f1-84eb-44e1a42ebb2f None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:13.354675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7cbf2-4873-49f1-84eb-44e1a42ebb2f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:13.356206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7cbf2-4873-49f1-84eb-44e1a42ebb2f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:13.388186 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5e917-2375-4abd-b414-07188f91aa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:13.388810 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5e917-2375-4abd-b414-07188f91aa69 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:13.389271 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5e917-2375-4abd-b414-07188f91aa69 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:13.389682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5e917-2375-4abd-b414-07188f91aa69 None admin] PATH_INFO: `/v3/users/307f76b84605446ea643922d0a93ba9f` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:13.391005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5e917-2375-4abd-b414-07188f91aa69 None admin] RBAC: Authorizing `identity:get_user(user_id=307f76b84605446ea643922d0a93ba9f)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:13.392608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5e917-2375-4abd-b414-07188f91aa69 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:13.394347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 17/33] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:13 2022] GET /identity/v3/users/307f76b84605446ea643922d0a93ba9f => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:13.395309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5e917-2375-4abd-b414-07188f91aa69 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:13.493784 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 17/34] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Aug 23 16:11:13 2022] POST /identity/v3/roles => generated 219 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:11:13.495668 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7cbf2-4873-49f1-84eb-44e1a42ebb2f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:13.500548 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5e917-2375-4abd-b414-07188f91aa69 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:13.528797 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:13.541811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb849968-7d49-4525-aa74-85f09e3aec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:13.542767 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb849968-7d49-4525-aa74-85f09e3aec84 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:13.543220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb849968-7d49-4525-aa74-85f09e3aec84 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:13.543694 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb849968-7d49-4525-aa74-85f09e3aec84 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:13.544547 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb849968-7d49-4525-aa74-85f09e3aec84 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:13.546240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb849968-7d49-4525-aa74-85f09e3aec84 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:13.628508 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7cbf2-4873-49f1-84eb-44e1a42ebb2f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:13.669202 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef4961-aa03-4330-83a2-f815d5c08007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:13.669937 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef4961-aa03-4330-83a2-f815d5c08007 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:13.670306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef4961-aa03-4330-83a2-f815d5c08007 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:13.670639 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef4961-aa03-4330-83a2-f815d5c08007 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:13.671378 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef4961-aa03-4330-83a2-f815d5c08007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:13.671813 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef4961-aa03-4330-83a2-f815d5c08007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:13.673400 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef4961-aa03-4330-83a2-f815d5c08007 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:13.688437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 18/35] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:13.689303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef4961-aa03-4330-83a2-f815d5c08007 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:13.704378 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 18/36] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Aug 23 16:11:13 2022] POST /identity/v3/roles => generated 225 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:11:13.705818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb849968-7d49-4525-aa74-85f09e3aec84 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:13.713820 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:13.827649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef4961-aa03-4330-83a2-f815d5c08007 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:13.869616 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd660a-1aba-4b97-8df6-f309d293d1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:13.871110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd660a-1aba-4b97-8df6-f309d293d1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:13.871539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd660a-1aba-4b97-8df6-f309d293d1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:13.871973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd660a-1aba-4b97-8df6-f309d293d1e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:13.873714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd660a-1aba-4b97-8df6-f309d293d1e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:13.875773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd660a-1aba-4b97-8df6-f309d293d1e2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:13.877856 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 19/37] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:13.887025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd660a-1aba-4b97-8df6-f309d293d1e2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:13.945496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb849968-7d49-4525-aa74-85f09e3aec84 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:13.995247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d9dd7-ca43-405d-aa0e-b47de7cb3ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:13.995875 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d9dd7-ca43-405d-aa0e-b47de7cb3ee9 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:13.996156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d9dd7-ca43-405d-aa0e-b47de7cb3ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:13.996435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d9dd7-ca43-405d-aa0e-b47de7cb3ee9 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:13.997096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d9dd7-ca43-405d-aa0e-b47de7cb3ee9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:13.998743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d9dd7-ca43-405d-aa0e-b47de7cb3ee9 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:14.003375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:14.023653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd660a-1aba-4b97-8df6-f309d293d1e2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:14.034553 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 19/38] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 16:11:13 2022] POST /identity/v3/projects => generated 301 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:11:14.035989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebdb2d-7ea2-4503-830a-057bb10dad34 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:14.036352 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebdb2d-7ea2-4503-830a-057bb10dad34 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:14.036696 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebdb2d-7ea2-4503-830a-057bb10dad34 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:14.038007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 20/39] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:14.044800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bc856-c342-4d1b-bff0-ce5e20a3f59c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:14.045105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bc856-c342-4d1b-bff0-ce5e20a3f59c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:14.045361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bc856-c342-4d1b-bff0-ce5e20a3f59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:14.067111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-fc1bc856-c342-4d1b-bff0-ce5e20a3f59c None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:14.068977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-fc1bc856-c342-4d1b-bff0-ce5e20a3f59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:14.080426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abaa278-1979-4f80-abcf-f1afb03c8d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:14.081194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaa278-1979-4f80-abcf-f1afb03c8d27 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:14.081477 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaa278-1979-4f80-abcf-f1afb03c8d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:14.081854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaa278-1979-4f80-abcf-f1afb03c8d27 None admin] PATH_INFO: `/v3/domains/default/users/307f76b84605446ea643922d0a93ba9f/roles/8de0c87242d7426ea25a510b578c02aa` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:14.086154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abaa278-1979-4f80-abcf-f1afb03c8d27 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=307f76b84605446ea643922d0a93ba9f, role_id=8de0c87242d7426ea25a510b578c02aa)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:14.088416 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abaa278-1979-4f80-abcf-f1afb03c8d27 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:14.111536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:14.115384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 20/40] 10.222.0.16 () {58 vars in 1361 bytes} [Tue Aug 23 16:11:13 2022] PUT /identity/v3/domains/default/users/307f76b84605446ea643922d0a93ba9f/roles/8de0c87242d7426ea25a510b578c02aa => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:11:14.172810 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 21/41] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:11:14.219906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bec22-f88b-4489-81bb-a29e6ed054f1 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:14.220399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bec22-f88b-4489-81bb-a29e6ed054f1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:14.220492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bec22-f88b-4489-81bb-a29e6ed054f1 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:14.221919 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 21/42] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:11:14.227659 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfa313-c482-4b35-83bc-8bf0f5cc0d7f None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:14.227945 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfa313-c482-4b35-83bc-8bf0f5cc0d7f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:14.228223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfa313-c482-4b35-83bc-8bf0f5cc0d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:14.249653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-0bcfa313-c482-4b35-83bc-8bf0f5cc0d7f None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:14.250992 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-0bcfa313-c482-4b35-83bc-8bf0f5cc0d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:14.332612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 22/43] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:14.461369 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bec22-f88b-4489-81bb-a29e6ed054f1 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:14.569100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bec22-f88b-4489-81bb-a29e6ed054f1 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:14.604058 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfa313-c482-4b35-83bc-8bf0f5cc0d7f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:14.606372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050d441-ecc7-4ba7-8c05-a3f5c4b891a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:14.606993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050d441-ecc7-4ba7-8c05-a3f5c4b891a3 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:14.607279 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050d441-ecc7-4ba7-8c05-a3f5c4b891a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:14.607558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050d441-ecc7-4ba7-8c05-a3f5c4b891a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:14.608231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050d441-ecc7-4ba7-8c05-a3f5c4b891a3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:14.609622 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050d441-ecc7-4ba7-8c05-a3f5c4b891a3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:14.629963 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Aug 23 16:11:14 2022] POST /identity/v3/roles => generated 223 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:11:14.719119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:14.726315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfa313-c482-4b35-83bc-8bf0f5cc0d7f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:14.763963 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaebbf2-0eca-47bc-a5f5-ad259dc4399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:14.764616 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaebbf2-0eca-47bc-a5f5-ad259dc4399f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:14.764903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaebbf2-0eca-47bc-a5f5-ad259dc4399f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:14.765184 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaebbf2-0eca-47bc-a5f5-ad259dc4399f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:14.766466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaebbf2-0eca-47bc-a5f5-ad259dc4399f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:14.767803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaebbf2-0eca-47bc-a5f5-ad259dc4399f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:14.770605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 23/45] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:14.775729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050d441-ecc7-4ba7-8c05-a3f5c4b891a3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:14.785123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:14.889672 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050d441-ecc7-4ba7-8c05-a3f5c4b891a3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:14.923080 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8edba-671e-4c30-828b-9d37fa7af3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:14.923693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8edba-671e-4c30-828b-9d37fa7af3a5 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:14.923976 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8edba-671e-4c30-828b-9d37fa7af3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:14.924251 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8edba-671e-4c30-828b-9d37fa7af3a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:14.924899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8edba-671e-4c30-828b-9d37fa7af3a5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:14.926373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8edba-671e-4c30-828b-9d37fa7af3a5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:14.954943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 16:11:14 2022] POST /identity/v3/projects => generated 312 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:11:16.109440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00fcd3-ae69-4b3e-9df5-aaa01996a90a None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:16.109980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00fcd3-ae69-4b3e-9df5-aaa01996a90a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:16.109980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00fcd3-ae69-4b3e-9df5-aaa01996a90a None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:16.111378 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 24/47] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:16.116634 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707c4f1-1cbf-419a-b990-f6d04403f111 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:16.117035 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707c4f1-1cbf-419a-b990-f6d04403f111 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:16.117201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707c4f1-1cbf-419a-b990-f6d04403f111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:16.136407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2707c4f1-1cbf-419a-b990-f6d04403f111 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:16.137984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2707c4f1-1cbf-419a-b990-f6d04403f111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:16.192578 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:16.208846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 24/48] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:16.482427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00fcd3-ae69-4b3e-9df5-aaa01996a90a None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:16.586106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00fcd3-ae69-4b3e-9df5-aaa01996a90a None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:16.620891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e57fba-146f-4683-8f68-39dd60352b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:16.621524 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e57fba-146f-4683-8f68-39dd60352b25 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:16.621808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e57fba-146f-4683-8f68-39dd60352b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:16.622106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e57fba-146f-4683-8f68-39dd60352b25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:16.632149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e57fba-146f-4683-8f68-39dd60352b25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:16.637398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-f4e57fba-146f-4683-8f68-39dd60352b25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:16.637398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:16.637398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:16.637398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:16.637398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:16.637398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:16.637398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:16.637398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:16.637398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:16.637398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:16.637398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:16.637398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:16.637398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:16.637398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:16.637398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:16.637398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:16.638246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:16.638246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:16.638246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:16.638246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:16.638246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:16.638246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:16.638246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:16.638246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:16.638246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:16.638246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:16.638246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:16.638246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:16.638246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:16.638246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:16.638246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:16.638246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:16.639093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:16.639093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:16.639093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:16.639093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:16.639093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:16.639093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:16.639093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:16.639093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:16.639093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:16.639093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:16.639093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:16.639093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:11:16.639093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 25/49] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:11:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:16.644284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707c4f1-1cbf-419a-b990-f6d04403f111 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:16.742113 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707c4f1-1cbf-419a-b990-f6d04403f111 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:16.775553 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8be154-1db7-4c57-855c-68ff1d19929b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:16.776169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8be154-1db7-4c57-855c-68ff1d19929b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:16.776456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8be154-1db7-4c57-855c-68ff1d19929b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:16.776736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8be154-1db7-4c57-855c-68ff1d19929b None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:16.777415 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8be154-1db7-4c57-855c-68ff1d19929b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:16.777727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8be154-1db7-4c57-855c-68ff1d19929b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:16.779163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8be154-1db7-4c57-855c-68ff1d19929b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:16.787434 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 25/50] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:16.793726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e57fba-146f-4683-8f68-39dd60352b25 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:16.855379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1227f59-3d83-4bf2-b3a3-a3c94548fb85 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:16.855379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1227f59-3d83-4bf2-b3a3-a3c94548fb85 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:16.855379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1227f59-3d83-4bf2-b3a3-a3c94548fb85 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:16.856797 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 26/51] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:11:16.862393 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db18b9b-c466-4a8f-88e6-2ad73ea476c5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:16.862680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db18b9b-c466-4a8f-88e6-2ad73ea476c5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:16.862956 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db18b9b-c466-4a8f-88e6-2ad73ea476c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:16.883232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9db18b9b-c466-4a8f-88e6-2ad73ea476c5 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:16.884473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9db18b9b-c466-4a8f-88e6-2ad73ea476c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:16.930513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:17.013941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e57fba-146f-4683-8f68-39dd60352b25 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:17.038463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:17.051241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497afe57-c2e3-4933-b28e-8c3abf454ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:17.051875 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497afe57-c2e3-4933-b28e-8c3abf454ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:17.052162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497afe57-c2e3-4933-b28e-8c3abf454ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:17.052435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497afe57-c2e3-4933-b28e-8c3abf454ee8 None admin] PATH_INFO: `/v3/users/307f76b84605446ea643922d0a93ba9f` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:17.053569 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497afe57-c2e3-4933-b28e-8c3abf454ee8 None admin] RBAC: Authorizing `identity:get_user(user_id=307f76b84605446ea643922d0a93ba9f)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:17.055070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497afe57-c2e3-4933-b28e-8c3abf454ee8 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:17.056710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 26/52] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:16 2022] GET /identity/v3/users/307f76b84605446ea643922d0a93ba9f => generated 247 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:17.060661 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 27/53] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:11:17.062623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497afe57-c2e3-4933-b28e-8c3abf454ee8 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:17.151367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:17.160976 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497afe57-c2e3-4933-b28e-8c3abf454ee8 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:17.198183 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e680b-2590-4ad1-b122-07d4bb070993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:17.198838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e680b-2590-4ad1-b122-07d4bb070993 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:17.199107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e680b-2590-4ad1-b122-07d4bb070993 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:17.199384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e680b-2590-4ad1-b122-07d4bb070993 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:17.200510 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e680b-2590-4ad1-b122-07d4bb070993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:17.201958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e680b-2590-4ad1-b122-07d4bb070993 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:17.203725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 27/54] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:17.209364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db18b9b-c466-4a8f-88e6-2ad73ea476c5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:17.306301 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db18b9b-c466-4a8f-88e6-2ad73ea476c5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:17.331043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e680b-2590-4ad1-b122-07d4bb070993 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:17.340962 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f93a7-0609-44e0-89ce-c02e59129493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:17.341577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f93a7-0609-44e0-89ce-c02e59129493 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:17.341860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f93a7-0609-44e0-89ce-c02e59129493 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:17.342158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f93a7-0609-44e0-89ce-c02e59129493 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:17.342887 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f93a7-0609-44e0-89ce-c02e59129493 None admin] RBAC: Adding query filter params (role.id=8de0c87242d7426ea25a510b578c02aa, scope.domain.id=default, user.id=307f76b84605446ea643922d0a93ba9f) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:17.343196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f93a7-0609-44e0-89ce-c02e59129493 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:17.344638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f93a7-0609-44e0-89ce-c02e59129493 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:17.353938 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1322 bytes} [Tue Aug 23 16:11:17 2022] GET /identity/v3/role_assignments?user.id=307f76b84605446ea643922d0a93ba9f&scope.domain.id=default&role.id=8de0c87242d7426ea25a510b578c02aa => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:17.439010 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e680b-2590-4ad1-b122-07d4bb070993 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:17.476064 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2c62d-4978-4f9d-a6ae-1d7e485299e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:17.476706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2c62d-4978-4f9d-a6ae-1d7e485299e6 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:17.476988 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2c62d-4978-4f9d-a6ae-1d7e485299e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:17.477260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2c62d-4978-4f9d-a6ae-1d7e485299e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:17.478930 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2c62d-4978-4f9d-a6ae-1d7e485299e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:17.480528 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2c62d-4978-4f9d-a6ae-1d7e485299e6 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:17.482195 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 28/56] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:17.488015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f93a7-0609-44e0-89ce-c02e59129493 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:17.538016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:17.592814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f93a7-0609-44e0-89ce-c02e59129493 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:17.625202 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db3fab-172e-4548-8f4e-89ac5bcb5173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:17.625814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db3fab-172e-4548-8f4e-89ac5bcb5173 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:17.626116 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db3fab-172e-4548-8f4e-89ac5bcb5173 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:17.626396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db3fab-172e-4548-8f4e-89ac5bcb5173 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:17.627042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db3fab-172e-4548-8f4e-89ac5bcb5173 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:17.628478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db3fab-172e-4548-8f4e-89ac5bcb5173 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:17.654521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 29/57] 10.222.0.16 () {60 vars in 1140 bytes} [Tue Aug 23 16:11:17 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:11:19.557114 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2541c-c437-45ef-b688-9e9586863c63 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:19.557638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2541c-c437-45ef-b688-9e9586863c63 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:19.557838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2541c-c437-45ef-b688-9e9586863c63 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:19.559241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 29/58] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:19.564570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd465ad-6002-49d0-96ad-14fde29aadee None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:19.564974 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd465ad-6002-49d0-96ad-14fde29aadee None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:19.565128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd465ad-6002-49d0-96ad-14fde29aadee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:19.583506 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0dd465ad-6002-49d0-96ad-14fde29aadee None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:19.584702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0dd465ad-6002-49d0-96ad-14fde29aadee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:19.649012 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 30/59] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:19.923229 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2541c-c437-45ef-b688-9e9586863c63 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:19.951459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:20.023027 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2541c-c437-45ef-b688-9e9586863c63 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:20.057823 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc5f93-cdd1-48e4-acd0-80f53953154c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:20.058465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc5f93-cdd1-48e4-acd0-80f53953154c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:20.058746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc5f93-cdd1-48e4-acd0-80f53953154c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:20.059026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc5f93-cdd1-48e4-acd0-80f53953154c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:20.060121 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc5f93-cdd1-48e4-acd0-80f53953154c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:20.061538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc5f93-cdd1-48e4-acd0-80f53953154c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:20.063115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 30/60] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:20.068557 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd465ad-6002-49d0-96ad-14fde29aadee None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:20.094869 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:20.165025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd465ad-6002-49d0-96ad-14fde29aadee None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:20.198801 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d130c42-e0c5-4f6b-af4e-1cdc982ae9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:20.199411 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d130c42-e0c5-4f6b-af4e-1cdc982ae9e8 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:20.199694 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d130c42-e0c5-4f6b-af4e-1cdc982ae9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:20.199970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d130c42-e0c5-4f6b-af4e-1cdc982ae9e8 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:20.200616 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d130c42-e0c5-4f6b-af4e-1cdc982ae9e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:20.202086 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d130c42-e0c5-4f6b-af4e-1cdc982ae9e8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:20.228104 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 31/61] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 16:11:20 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:11:23.097993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c582e-2495-4edc-a17a-cdbfaab21dd2 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:23.098882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c582e-2495-4edc-a17a-cdbfaab21dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:23.099465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c582e-2495-4edc-a17a-cdbfaab21dd2 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:23.101160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 31/62] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:23.107431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72768bc6-6436-440f-b6f9-67a5a93eb867 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:23.108252 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72768bc6-6436-440f-b6f9-67a5a93eb867 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:23.108746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72768bc6-6436-440f-b6f9-67a5a93eb867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:23.136009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-72768bc6-6436-440f-b6f9-67a5a93eb867 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:23.137549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-72768bc6-6436-440f-b6f9-67a5a93eb867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:23.230959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 32/63] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:23.442757 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f5ec1-f911-4349-ad94-2c1ed9c45eb5 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:23.443038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f5ec1-f911-4349-ad94-2c1ed9c45eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:23.443238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f5ec1-f911-4349-ad94-2c1ed9c45eb5 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:23.444879 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 32/64] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:23.450850 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c843831-5fb0-458b-a716-7af18b97e2ec None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:23.451398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c843831-5fb0-458b-a716-7af18b97e2ec None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:23.451871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c843831-5fb0-458b-a716-7af18b97e2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:23.479632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1c843831-5fb0-458b-a716-7af18b97e2ec None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:23.481174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1c843831-5fb0-458b-a716-7af18b97e2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:23.489472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:23.502866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d3c72-2c2e-4c16-bff1-b8bb19933a17 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:23.503463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d3c72-2c2e-4c16-bff1-b8bb19933a17 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:23.503931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d3c72-2c2e-4c16-bff1-b8bb19933a17 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:23.505494 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 33/65] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:23.511363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ac1a0-2b62-4159-bd4c-58b1585fe625 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:23.511948 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ac1a0-2b62-4159-bd4c-58b1585fe625 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:23.512417 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ac1a0-2b62-4159-bd4c-58b1585fe625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:23.548466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-203ac1a0-2b62-4159-bd4c-58b1585fe625 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:23.549686 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-203ac1a0-2b62-4159-bd4c-58b1585fe625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:23.597423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 33/66] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:23.605460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c843831-5fb0-458b-a716-7af18b97e2ec None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:23.704805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 34/67] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:11:23.756571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c843831-5fb0-458b-a716-7af18b97e2ec None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:23.792703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb97fd7-bd04-4353-9028-88470d526cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:23.793577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb97fd7-bd04-4353-9028-88470d526cda None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:23.794027 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb97fd7-bd04-4353-9028-88470d526cda None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:23.794466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb97fd7-bd04-4353-9028-88470d526cda None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:23.806347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb97fd7-bd04-4353-9028-88470d526cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:23.813268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-7eb97fd7-bd04-4353-9028-88470d526cda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:23.813268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:23.813268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:23.813268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:23.813268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:23.813268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:23.813268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:23.813268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:23.813268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:23.813268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:23.813268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:23.813268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:23.813268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:23.813268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:23.813268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:23.813268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:23.814461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:23.814461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:23.814461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:23.814461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:23.814461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:23.814461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:23.814461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:23.814461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:23.814461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:23.814461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:23.814461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:23.814461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:23.814461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:23.814461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:23.814461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:23.814461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:23.815401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:23.815401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:23.815401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:23.815401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:23.815401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:23.815401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:23.815401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:23.815401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:23.815401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:23.815401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:23.815401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:23.815401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:23.817303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 34/68] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:23.823348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ac1a0-2b62-4159-bd4c-58b1585fe625 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:23.854821 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:23.882243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572eb37-0d83-413e-a143-09c9ec780793 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:23.882870 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572eb37-0d83-413e-a143-09c9ec780793 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:23.883336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572eb37-0d83-413e-a143-09c9ec780793 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:23.885564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 35/69] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:23.895840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8bbae-ad1b-4312-987a-1c0f8880bb9a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:23.896472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8bbae-ad1b-4312-987a-1c0f8880bb9a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:23.896942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8bbae-ad1b-4312-987a-1c0f8880bb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:23.906400 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:23.918707 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b3e8bbae-ad1b-4312-987a-1c0f8880bb9a None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:23.919916 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b3e8bbae-ad1b-4312-987a-1c0f8880bb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:23.972683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ac1a0-2b62-4159-bd4c-58b1585fe625 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:23.996988 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 36/70] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:11:23.998490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3e0da-1554-4969-aa4b-b0b3c818c54d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:23.998925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3e0da-1554-4969-aa4b-b0b3c818c54d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:23.999347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3e0da-1554-4969-aa4b-b0b3c818c54d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:24.000987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 37/71] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:24.001833 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3e0da-1554-4969-aa4b-b0b3c818c54d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:24.021237 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acdd789-11e5-41f6-9a22-9619db7ac4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:24.022341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdd789-11e5-41f6-9a22-9619db7ac4fc None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:24.022884 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdd789-11e5-41f6-9a22-9619db7ac4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:24.023164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdd789-11e5-41f6-9a22-9619db7ac4fc None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:24.024049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acdd789-11e5-41f6-9a22-9619db7ac4fc None admin] RBAC: Adding query filter params (name=member) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:24.024369 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acdd789-11e5-41f6-9a22-9619db7ac4fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:24.026424 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acdd789-11e5-41f6-9a22-9619db7ac4fc None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:24.038346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 35/72] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:24.040089 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a83f1-af2a-4c75-830f-4848ac90dcba None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:24.040697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a83f1-af2a-4c75-830f-4848ac90dcba None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:24.041143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a83f1-af2a-4c75-830f-4848ac90dcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:24.063946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-1e3a83f1-af2a-4c75-830f-4848ac90dcba None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:24.065815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1e3a83f1-af2a-4c75-830f-4848ac90dcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:24.120923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3e0da-1554-4969-aa4b-b0b3c818c54d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:24.145326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 36/73] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:24.146096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a83f1-af2a-4c75-830f-4848ac90dcba None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:24.161139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:24.168883 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:24.171199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e7ab1-43f6-435f-ab63-0880b2a6bd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:24.172009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e7ab1-43f6-435f-ab63-0880b2a6bd0b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:24.172408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e7ab1-43f6-435f-ab63-0880b2a6bd0b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:24.173053 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e7ab1-43f6-435f-ab63-0880b2a6bd0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:24.186346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e7ab1-43f6-435f-ab63-0880b2a6bd0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:24.192332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-da8e7ab1-43f6-435f-ab63-0880b2a6bd0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:24.192332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:24.192332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:24.192332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:24.192332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:24.192332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:24.192332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:24.192332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:24.192332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:24.192332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:24.192332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:24.192332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:24.192332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:24.192332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:24.192332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:24.192332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:24.193403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:24.193403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:24.193403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:24.193403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:24.193403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:24.193403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:24.193403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:24.193403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:24.193403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:24.193403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:24.193403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:24.193403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:24.193403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:24.193403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:24.193403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:24.193403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:24.194418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:24.194418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:24.194418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:24.194418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:24.194418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:24.194418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:24.194418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:24.194418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:24.194418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:24.194418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:24.194418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:24.194418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:24.195619 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 38/74] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:11:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:24.196662 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e7ab1-43f6-435f-ab63-0880b2a6bd0b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:24.279394 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a83f1-af2a-4c75-830f-4848ac90dcba None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:24.314109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e7ab1-43f6-435f-ab63-0880b2a6bd0b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:24.325591 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f69346-992d-406f-b394-3747b6b1dd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:24.326259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f69346-992d-406f-b394-3747b6b1dd88 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:24.326576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f69346-992d-406f-b394-3747b6b1dd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:24.326855 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f69346-992d-406f-b394-3747b6b1dd88 None admin] PATH_INFO: `/v3/users/c194e717ca3a4063b26b04df33afe67b` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:24.340342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f69346-992d-406f-b394-3747b6b1dd88 None admin] RBAC: Authorizing `identity:get_user(user_id=c194e717ca3a4063b26b04df33afe67b)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:24.341799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f69346-992d-406f-b394-3747b6b1dd88 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:24.343181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecef42-73ac-4b8c-a767-82d2a22217eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:24.343453 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:24 2022] GET /identity/v3/users/c194e717ca3a4063b26b04df33afe67b => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:24.344221 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f69346-992d-406f-b394-3747b6b1dd88 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:24.348614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecef42-73ac-4b8c-a767-82d2a22217eb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:24.348909 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecef42-73ac-4b8c-a767-82d2a22217eb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:24.349199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecef42-73ac-4b8c-a767-82d2a22217eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:24.361296 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecef42-73ac-4b8c-a767-82d2a22217eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:24.366037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-55ecef42-73ac-4b8c-a767-82d2a22217eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:11:24.366037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:24.366037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:24.366037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:24.366037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:24.366037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:24.366037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:24.366037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:24.366037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:24.366037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:24.366037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:24.366037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:24.366037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:24.366037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:24.366037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:24.366037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:24.366947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:24.366947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:24.366947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:24.366947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:24.366947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:24.366947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:24.366947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:24.366947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:24.366947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:24.366947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:24.366947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:24.366947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:24.366947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:24.366947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:24.366947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:24.366947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:24.367704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:24.367704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:24.367704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:24.367704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:24.367704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:24.367704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:24.367704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:24.367704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:24.367704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:24.367704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:24.367704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:11:24.367704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:24.367704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 39/76] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:11:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:24.371659 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecef42-73ac-4b8c-a767-82d2a22217eb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:24.429014 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:24.430041 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:24.455634 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f69346-992d-406f-b394-3747b6b1dd88 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:24.478240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecef42-73ac-4b8c-a767-82d2a22217eb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:24.490273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a125e-5d0c-488a-9f4c-7e490da74d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:24.490880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a125e-5d0c-488a-9f4c-7e490da74d3b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:24.491160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a125e-5d0c-488a-9f4c-7e490da74d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:24.491438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a125e-5d0c-488a-9f4c-7e490da74d3b None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:24.492102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a125e-5d0c-488a-9f4c-7e490da74d3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:24.492401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a125e-5d0c-488a-9f4c-7e490da74d3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:24.493776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a125e-5d0c-488a-9f4c-7e490da74d3b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:24.502048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 38/77] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:24.503033 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a125e-5d0c-488a-9f4c-7e490da74d3b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:24.513486 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357a7b9-6c67-4d19-8c5f-5973b192a880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:24.514144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357a7b9-6c67-4d19-8c5f-5973b192a880 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:24.514425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357a7b9-6c67-4d19-8c5f-5973b192a880 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:24.514695 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357a7b9-6c67-4d19-8c5f-5973b192a880 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:24.516099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357a7b9-6c67-4d19-8c5f-5973b192a880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:24.517545 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357a7b9-6c67-4d19-8c5f-5973b192a880 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:24.519133 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 40/78] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:24.519133 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357a7b9-6c67-4d19-8c5f-5973b192a880 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:24.606008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a125e-5d0c-488a-9f4c-7e490da74d3b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:24.619183 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357a7b9-6c67-4d19-8c5f-5973b192a880 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:24.640386 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d038a-397b-4ec8-b7b3-7ffbbf7aa334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:24.640741 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:24.640992 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d038a-397b-4ec8-b7b3-7ffbbf7aa334 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:24.641272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d038a-397b-4ec8-b7b3-7ffbbf7aa334 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:24.641545 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d038a-397b-4ec8-b7b3-7ffbbf7aa334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:24.650614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:24.655447 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf8099-b54a-43f4-9a32-6d0334289205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:24.656255 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf8099-b54a-43f4-9a32-6d0334289205 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:24.656540 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf8099-b54a-43f4-9a32-6d0334289205 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:24.656818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf8099-b54a-43f4-9a32-6d0334289205 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:24.657744 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf8099-b54a-43f4-9a32-6d0334289205 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:24.658049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf8099-b54a-43f4-9a32-6d0334289205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:24.659446 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf8099-b54a-43f4-9a32-6d0334289205 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:24.667538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 41/79] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:11:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:24.668341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf8099-b54a-43f4-9a32-6d0334289205 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:24.712326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d038a-397b-4ec8-b7b3-7ffbbf7aa334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:24.714727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d038a-397b-4ec8-b7b3-7ffbbf7aa334 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:24.766726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf8099-b54a-43f4-9a32-6d0334289205 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:24.800154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d4a8f-1a1a-43ba-acde-41ffd02944ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:24.801003 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d4a8f-1a1a-43ba-acde-41ffd02944ea None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:24.801446 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d4a8f-1a1a-43ba-acde-41ffd02944ea None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:24.801723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d4a8f-1a1a-43ba-acde-41ffd02944ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:24.812442 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d4a8f-1a1a-43ba-acde-41ffd02944ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:24.817215 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 39/80] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:11:24.817612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-224d4a8f-1a1a-43ba-acde-41ffd02944ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:24.817612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:24.817612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:24.817612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:24.817612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:24.817612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:24.817612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:24.817612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:24.817612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:24.817612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:24.817612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:24.817612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:24.817612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:24.817612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:24.817612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:24.817612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:24.818640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:24.818640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:24.818640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:24.818640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:24.818640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:24.818640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:24.818640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:24.818640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:24.818640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:24.818640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:24.818640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:24.818640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:24.818640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:24.818640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:24.818640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:24.818640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:24.819431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:24.819431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:24.819431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:24.819431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:24.819431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:24.819431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:24.819431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:24.819431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:24.819431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:24.819431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:24.819431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:24.819431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:24.820014 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d038a-397b-4ec8-b7b3-7ffbbf7aa334 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:24.820079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 42/81] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:24.820079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d4a8f-1a1a-43ba-acde-41ffd02944ea None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:24.857951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:24.864721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:24.920253 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d038a-397b-4ec8-b7b3-7ffbbf7aa334 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:24.922049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d4a8f-1a1a-43ba-acde-41ffd02944ea None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:24.958012 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb56b8-da42-42f2-953f-1f881aa2cc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:24.958232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d42e56-9eb3-42f9-8e2c-18cf02fd3838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:24.958672 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb56b8-da42-42f2-953f-1f881aa2cc45 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:24.958766 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d42e56-9eb3-42f9-8e2c-18cf02fd3838 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:24.958956 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb56b8-da42-42f2-953f-1f881aa2cc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:24.959044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d42e56-9eb3-42f9-8e2c-18cf02fd3838 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:24.959231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb56b8-da42-42f2-953f-1f881aa2cc45 None admin] PATH_INFO: `/v3/users/307f76b84605446ea643922d0a93ba9f` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:24.959326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d42e56-9eb3-42f9-8e2c-18cf02fd3838 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:24.959889 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d42e56-9eb3-42f9-8e2c-18cf02fd3838 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:24.960359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb56b8-da42-42f2-953f-1f881aa2cc45 None admin] RBAC: Authorizing `identity:get_user(user_id=307f76b84605446ea643922d0a93ba9f)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:24.961352 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d42e56-9eb3-42f9-8e2c-18cf02fd3838 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:24.961791 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb56b8-da42-42f2-953f-1f881aa2cc45 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:24.963413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 40/82] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:24 2022] GET /identity/v3/users/307f76b84605446ea643922d0a93ba9f => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:24.964163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb56b8-da42-42f2-953f-1f881aa2cc45 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:24.984986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 43/83] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 16:11:24 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:11:24.985822 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d42e56-9eb3-42f9-8e2c-18cf02fd3838 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:25.078978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb56b8-da42-42f2-953f-1f881aa2cc45 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:25.087550 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:25.114314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:25.118746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d42e56-9eb3-42f9-8e2c-18cf02fd3838 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:25.122165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef7568-e720-4c52-bb4d-e027d8131a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:25.123736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef7568-e720-4c52-bb4d-e027d8131a6b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:25.124021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef7568-e720-4c52-bb4d-e027d8131a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:25.124336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef7568-e720-4c52-bb4d-e027d8131a6b None admin] PATH_INFO: `/v3/users/c194e717ca3a4063b26b04df33afe67b` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:25.125664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef7568-e720-4c52-bb4d-e027d8131a6b None admin] RBAC: Authorizing `identity:get_user(user_id=c194e717ca3a4063b26b04df33afe67b)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:25.127187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef7568-e720-4c52-bb4d-e027d8131a6b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:25.128799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 41/84] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:24 2022] GET /identity/v3/users/c194e717ca3a4063b26b04df33afe67b => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:25.130045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef7568-e720-4c52-bb4d-e027d8131a6b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:25.161882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b6cc1-a10e-44a3-b636-66d2699af7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:25.162579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b6cc1-a10e-44a3-b636-66d2699af7e0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:25.162873 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b6cc1-a10e-44a3-b636-66d2699af7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:25.163206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b6cc1-a10e-44a3-b636-66d2699af7e0 None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:25.164432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b6cc1-a10e-44a3-b636-66d2699af7e0 None admin] RBAC: Authorizing `identity:get_project(project_id=f39fd5a3969c4e89ad6198892166ec4d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:25.165968 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b6cc1-a10e-44a3-b636-66d2699af7e0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:25.169241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 44/85] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:24 2022] GET /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:25.170030 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b6cc1-a10e-44a3-b636-66d2699af7e0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:25.258445 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef7568-e720-4c52-bb4d-e027d8131a6b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:25.295175 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b6cc1-a10e-44a3-b636-66d2699af7e0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:25.307566 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87949b-5c30-436f-86b1-6da803e1d245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:25.308649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87949b-5c30-436f-86b1-6da803e1d245 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:25.309220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87949b-5c30-436f-86b1-6da803e1d245 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:25.309506 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87949b-5c30-436f-86b1-6da803e1d245 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:25.310251 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87949b-5c30-436f-86b1-6da803e1d245 None admin] RBAC: Adding query filter params (name=member) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:25.310717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87949b-5c30-436f-86b1-6da803e1d245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:25.312723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87949b-5c30-436f-86b1-6da803e1d245 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:25.321579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 42/86] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:25.322343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87949b-5c30-436f-86b1-6da803e1d245 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:25.344387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a1637-b272-4866-ba24-ca85b811e040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:25.345578 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a1637-b272-4866-ba24-ca85b811e040 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:25.346050 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a1637-b272-4866-ba24-ca85b811e040 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:25.346580 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a1637-b272-4866-ba24-ca85b811e040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:25.390559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:25.398729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:25.438212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a1637-b272-4866-ba24-ca85b811e040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:25.439680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a1637-b272-4866-ba24-ca85b811e040 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:25.441664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87949b-5c30-436f-86b1-6da803e1d245 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:25.485548 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c75a0f-2eac-4853-bfdb-47cc4a69f831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:25.486202 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c75a0f-2eac-4853-bfdb-47cc4a69f831 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:25.486486 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c75a0f-2eac-4853-bfdb-47cc4a69f831 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:25.486765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c75a0f-2eac-4853-bfdb-47cc4a69f831 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:25.564854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c75a0f-2eac-4853-bfdb-47cc4a69f831 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:25.567262 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c75a0f-2eac-4853-bfdb-47cc4a69f831 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:25.568775 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 45/87] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:11:25.569935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a1637-b272-4866-ba24-ca85b811e040 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:25.609203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:25.657146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:25.685327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 43/88] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:11:25.690977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c75a0f-2eac-4853-bfdb-47cc4a69f831 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:25.704804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a1637-b272-4866-ba24-ca85b811e040 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:25.745635 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817131d-da6a-4c9a-9eb1-89ed747d9635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:25.746709 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817131d-da6a-4c9a-9eb1-89ed747d9635 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:25.747194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817131d-da6a-4c9a-9eb1-89ed747d9635 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:25.747700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817131d-da6a-4c9a-9eb1-89ed747d9635 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:25.748638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817131d-da6a-4c9a-9eb1-89ed747d9635 None admin] RBAC: Adding query filter params (role.id=8e4aa52bcd2a47389ee1c5de44fa28ca, scope.project.id=f39fd5a3969c4e89ad6198892166ec4d, user.id=c194e717ca3a4063b26b04df33afe67b) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:25.749168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817131d-da6a-4c9a-9eb1-89ed747d9635 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:25.750849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817131d-da6a-4c9a-9eb1-89ed747d9635 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:25.756830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 46/89] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:11:25 2022] GET /identity/v3/role_assignments?user.id=c194e717ca3a4063b26b04df33afe67b&scope.project.id=f39fd5a3969c4e89ad6198892166ec4d&role.id=8e4aa52bcd2a47389ee1c5de44fa28ca => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:25.757868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817131d-da6a-4c9a-9eb1-89ed747d9635 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:25.856077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c75a0f-2eac-4853-bfdb-47cc4a69f831 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:25.936154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817131d-da6a-4c9a-9eb1-89ed747d9635 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:25.944044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f0993-81d6-4aff-9c4b-e89b6210f7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:25.944692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f0993-81d6-4aff-9c4b-e89b6210f7aa None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:25.945028 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f0993-81d6-4aff-9c4b-e89b6210f7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:25.945306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f0993-81d6-4aff-9c4b-e89b6210f7aa None admin] PATH_INFO: `/v3/users/c194e717ca3a4063b26b04df33afe67b` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:25.946530 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f0993-81d6-4aff-9c4b-e89b6210f7aa None admin] RBAC: Authorizing `identity:get_user(user_id=c194e717ca3a4063b26b04df33afe67b)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:25.948034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f0993-81d6-4aff-9c4b-e89b6210f7aa None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:25.949730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 44/90] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:25 2022] GET /identity/v3/users/c194e717ca3a4063b26b04df33afe67b => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:25.950679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f0993-81d6-4aff-9c4b-e89b6210f7aa None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:25.954629 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:25.972525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:25.985905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c8c6b-388d-4a08-9295-86f0ea42aceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:25.985905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c8c6b-388d-4a08-9295-86f0ea42aceb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:25.985905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c8c6b-388d-4a08-9295-86f0ea42aceb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:25.985905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c8c6b-388d-4a08-9295-86f0ea42aceb None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:25.986342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c8c6b-388d-4a08-9295-86f0ea42aceb None admin] RBAC: Authorizing `identity:get_project(project_id=f39fd5a3969c4e89ad6198892166ec4d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:25.986342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c8c6b-388d-4a08-9295-86f0ea42aceb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:25.986813 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 47/91] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:25 2022] GET /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:25.987444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c8c6b-388d-4a08-9295-86f0ea42aceb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:26.097125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c8c6b-388d-4a08-9295-86f0ea42aceb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:26.124006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f0993-81d6-4aff-9c4b-e89b6210f7aa None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:26.138090 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bc204-1d97-42d0-a319-82662d5c36b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:26.138090 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bc204-1d97-42d0-a319-82662d5c36b6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:26.138090 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bc204-1d97-42d0-a319-82662d5c36b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:26.138090 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bc204-1d97-42d0-a319-82662d5c36b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:26.187091 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706be51-551b-428a-ac9e-d14e444b457c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:26.187964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706be51-551b-428a-ac9e-d14e444b457c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:26.188401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706be51-551b-428a-ac9e-d14e444b457c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:26.188819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706be51-551b-428a-ac9e-d14e444b457c None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:26.190170 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706be51-551b-428a-ac9e-d14e444b457c None admin] RBAC: Authorizing `identity:get_project(project_id=f39fd5a3969c4e89ad6198892166ec4d)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:26.191791 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706be51-551b-428a-ac9e-d14e444b457c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:26.193596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 45/92] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:25 2022] GET /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:26.194695 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706be51-551b-428a-ac9e-d14e444b457c None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:26.230831 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:26.238690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bc204-1d97-42d0-a319-82662d5c36b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:26.240518 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bc204-1d97-42d0-a319-82662d5c36b6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:26.325823 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:26.379038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706be51-551b-428a-ac9e-d14e444b457c None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:26.426694 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 48/93] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:11:26.427562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bc204-1d97-42d0-a319-82662d5c36b6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:26.452175 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cda77-a7dd-43e5-9c9b-d25ee8f87778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:26.452694 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cda77-a7dd-43e5-9c9b-d25ee8f87778 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:26.452974 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cda77-a7dd-43e5-9c9b-d25ee8f87778 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:26.453246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cda77-a7dd-43e5-9c9b-d25ee8f87778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:26.453986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cda77-a7dd-43e5-9c9b-d25ee8f87778 None admin] RBAC: Adding query filter params (role.id=8de0c87242d7426ea25a510b578c02aa, scope.project.id=f39fd5a3969c4e89ad6198892166ec4d, user.id=307f76b84605446ea643922d0a93ba9f) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:26.454321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cda77-a7dd-43e5-9c9b-d25ee8f87778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:26.455759 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cda77-a7dd-43e5-9c9b-d25ee8f87778 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:26.470608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 46/94] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:11:26 2022] GET /identity/v3/role_assignments?user.id=307f76b84605446ea643922d0a93ba9f&scope.project.id=f39fd5a3969c4e89ad6198892166ec4d&role.id=8de0c87242d7426ea25a510b578c02aa => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:26.471202 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cda77-a7dd-43e5-9c9b-d25ee8f87778 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:26.657435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:26.664249 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bc204-1d97-42d0-a319-82662d5c36b6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:26.717945 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d7085-b4f0-4208-8eb3-195d27ccc8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:26.718513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d7085-b4f0-4208-8eb3-195d27ccc8cd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:26.718796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d7085-b4f0-4208-8eb3-195d27ccc8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:26.719069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d7085-b4f0-4208-8eb3-195d27ccc8cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:26.719803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d7085-b4f0-4208-8eb3-195d27ccc8cd None admin] RBAC: Adding query filter params (role.id=41d658f3417e4e48b117d57120991ad8, scope.project.id=f39fd5a3969c4e89ad6198892166ec4d, user.id=c194e717ca3a4063b26b04df33afe67b) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:26.720112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d7085-b4f0-4208-8eb3-195d27ccc8cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:26.721551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d7085-b4f0-4208-8eb3-195d27ccc8cd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:26.727253 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cda77-a7dd-43e5-9c9b-d25ee8f87778 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:26.741271 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 49/95] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:11:26 2022] GET /identity/v3/role_assignments?user.id=c194e717ca3a4063b26b04df33afe67b&scope.project.id=f39fd5a3969c4e89ad6198892166ec4d&role.id=41d658f3417e4e48b117d57120991ad8 => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:26.782262 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2010f80-ca4a-455d-91a3-6d7b701abc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:26.783174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2010f80-ca4a-455d-91a3-6d7b701abc58 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:26.783455 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2010f80-ca4a-455d-91a3-6d7b701abc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:26.783794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2010f80-ca4a-455d-91a3-6d7b701abc58 None admin] PATH_INFO: `/v3/projects/9a26874f45bb48e589edbfb3370f51a6` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:26.784955 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2010f80-ca4a-455d-91a3-6d7b701abc58 None admin] RBAC: Authorizing `identity:get_project(project_id=9a26874f45bb48e589edbfb3370f51a6)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:26.786441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2010f80-ca4a-455d-91a3-6d7b701abc58 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:26.788386 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 47/96] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:26 2022] GET /identity/v3/projects/9a26874f45bb48e589edbfb3370f51a6 => generated 312 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:26.794611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d7085-b4f0-4208-8eb3-195d27ccc8cd None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:26.909603 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d7085-b4f0-4208-8eb3-195d27ccc8cd None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:26.954381 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689309d9-ee6b-41eb-8b79-d357705fdb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:26.955302 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689309d9-ee6b-41eb-8b79-d357705fdb15 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:26.955597 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689309d9-ee6b-41eb-8b79-d357705fdb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:26.955887 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689309d9-ee6b-41eb-8b79-d357705fdb15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:26.956639 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689309d9-ee6b-41eb-8b79-d357705fdb15 None admin] RBAC: Adding query filter params (role.id=8e4aa52bcd2a47389ee1c5de44fa28ca, scope.project.id=9a26874f45bb48e589edbfb3370f51a6, user.id=c194e717ca3a4063b26b04df33afe67b) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:26.957206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689309d9-ee6b-41eb-8b79-d357705fdb15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:26.959211 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689309d9-ee6b-41eb-8b79-d357705fdb15 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:26.965872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 50/97] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:11:26 2022] GET /identity/v3/role_assignments?user.id=c194e717ca3a4063b26b04df33afe67b&scope.project.id=9a26874f45bb48e589edbfb3370f51a6&role.id=8e4aa52bcd2a47389ee1c5de44fa28ca => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:27.289559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5401ac-cb43-4e50-adf6-f934c3ebe23a None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:27.289905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5401ac-cb43-4e50-adf6-f934c3ebe23a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:27.290158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5401ac-cb43-4e50-adf6-f934c3ebe23a None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:27.292232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 48/98] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:27.298199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48925c5b-0b46-4cf4-99fd-2ae7cd327591 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:27.298650 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48925c5b-0b46-4cf4-99fd-2ae7cd327591 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:27.298819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48925c5b-0b46-4cf4-99fd-2ae7cd327591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:27.317734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-48925c5b-0b46-4cf4-99fd-2ae7cd327591 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:27.323923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-48925c5b-0b46-4cf4-99fd-2ae7cd327591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:27.350639 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:27.381544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67e3a0-d5ae-4d0b-84ad-6b778e568134 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:27.382032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67e3a0-d5ae-4d0b-84ad-6b778e568134 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:27.382124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67e3a0-d5ae-4d0b-84ad-6b778e568134 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:27.383896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 49/99] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:27.403542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf0e39-095b-4684-92de-741d4a4069e7 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:27.403920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf0e39-095b-4684-92de-741d4a4069e7 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:27.404109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf0e39-095b-4684-92de-741d4a4069e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:27.430522 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:27.438241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 51/100] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:27.443274 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-6abf0e39-095b-4684-92de-741d4a4069e7 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:27.444493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6abf0e39-095b-4684-92de-741d4a4069e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:27.545873 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 50/101] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:11:27.832028 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48925c5b-0b46-4cf4-99fd-2ae7cd327591 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:27.963771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48925c5b-0b46-4cf4-99fd-2ae7cd327591 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:28.012560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6341f9-fb68-4910-983e-45f78e0cfbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:28.013206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6341f9-fb68-4910-983e-45f78e0cfbee None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:28.013491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6341f9-fb68-4910-983e-45f78e0cfbee None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:28.013769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6341f9-fb68-4910-983e-45f78e0cfbee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:28.014940 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6341f9-fb68-4910-983e-45f78e0cfbee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:28.016402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6341f9-fb68-4910-983e-45f78e0cfbee None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:28.018290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 52/102] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:28.023807 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf0e39-095b-4684-92de-741d4a4069e7 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:28.071491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6341f9-fb68-4910-983e-45f78e0cfbee None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:28.113596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:28.213762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf0e39-095b-4684-92de-741d4a4069e7 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:28.254466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6341f9-fb68-4910-983e-45f78e0cfbee None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:28.277058 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e5e62-c126-4896-9404-7d7e2ba77e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:28.278137 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e5e62-c126-4896-9404-7d7e2ba77e6f None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:28.278613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e5e62-c126-4896-9404-7d7e2ba77e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:28.279078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e5e62-c126-4896-9404-7d7e2ba77e6f None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:28.279935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e5e62-c126-4896-9404-7d7e2ba77e6f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:28.281593 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e5e62-c126-4896-9404-7d7e2ba77e6f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:28.287218 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:28.304200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bf9d9-4930-444e-81c4-f9451596e04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:28.304842 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bf9d9-4930-444e-81c4-f9451596e04f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:28.305122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bf9d9-4930-444e-81c4-f9451596e04f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:28.305401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bf9d9-4930-444e-81c4-f9451596e04f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:28.320291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bf9d9-4930-444e-81c4-f9451596e04f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:28.328049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-733bf9d9-4930-444e-81c4-f9451596e04f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:11:28.328049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:28.328049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:28.328049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:28.328049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:28.328049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:28.328049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:28.328049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:28.328049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:28.328049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:28.328049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:28.328049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:28.328049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:28.328049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:28.328049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:28.328049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:28.329224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:28.329224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:28.329224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:28.329224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:28.329224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:28.329224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:28.329224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:28.329224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:28.329224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:28.329224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:28.329224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:28.329224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:28.329224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:28.329224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:28.329224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:28.329224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:28.329986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:28.329986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:28.329986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:28.329986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:28.329986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:28.329986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:28.329986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:28.329986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:28.329986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:28.329986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:28.329986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:11:28.329986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:28.329986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 53/103] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:11:28.334110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bf9d9-4930-444e-81c4-f9451596e04f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:28.335208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 51/104] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 16:11:28 2022] POST /identity/v3/projects => generated 302 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:11:28.439435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:28.461228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bf9d9-4930-444e-81c4-f9451596e04f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:28.512372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7c016-ba2f-493e-89ad-a850bbdc49f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:28.513005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7c016-ba2f-493e-89ad-a850bbdc49f5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:28.513294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7c016-ba2f-493e-89ad-a850bbdc49f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:28.513634 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7c016-ba2f-493e-89ad-a850bbdc49f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:28.514388 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7c016-ba2f-493e-89ad-a850bbdc49f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:28.514868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7c016-ba2f-493e-89ad-a850bbdc49f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:28.516275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7c016-ba2f-493e-89ad-a850bbdc49f5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:28.530712 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 54/105] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:28.536697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e5e62-c126-4896-9404-7d7e2ba77e6f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:28.664298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e5e62-c126-4896-9404-7d7e2ba77e6f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:28.700492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ee280-fe4f-4f23-902e-4c7f1420f163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:28.701473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ee280-fe4f-4f23-902e-4c7f1420f163 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:28.701949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ee280-fe4f-4f23-902e-4c7f1420f163 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:28.702439 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ee280-fe4f-4f23-902e-4c7f1420f163 None admin] PATH_INFO: `/v3/users/5cc893e83f404c8595be758b5fbf60ff` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:28.716577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ee280-fe4f-4f23-902e-4c7f1420f163 None admin] RBAC: Authorizing `identity:get_user(user_id=5cc893e83f404c8595be758b5fbf60ff)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:28.718404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ee280-fe4f-4f23-902e-4c7f1420f163 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:28.720288 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 52/106] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:28 2022] GET /identity/v3/users/5cc893e83f404c8595be758b5fbf60ff => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:28.727471 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7c016-ba2f-493e-89ad-a850bbdc49f5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:28.839247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7c016-ba2f-493e-89ad-a850bbdc49f5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:28.875439 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4e667-695d-4101-9117-f2ba1c81346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:28.876467 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4e667-695d-4101-9117-f2ba1c81346c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:28.876943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4e667-695d-4101-9117-f2ba1c81346c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:28.877407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4e667-695d-4101-9117-f2ba1c81346c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:28.895981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:28.956487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4e667-695d-4101-9117-f2ba1c81346c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:28.958266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4e667-695d-4101-9117-f2ba1c81346c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:29.089227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 55/107] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 16:11:29.094990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ee280-fe4f-4f23-902e-4c7f1420f163 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:29.145793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:29.215568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ee280-fe4f-4f23-902e-4c7f1420f163 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:29.256227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1daa74-c40b-438f-b8b6-5e73e1acc341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:29.257033 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1daa74-c40b-438f-b8b6-5e73e1acc341 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:29.257321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1daa74-c40b-438f-b8b6-5e73e1acc341 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:29.257597 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1daa74-c40b-438f-b8b6-5e73e1acc341 None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:29.258839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1daa74-c40b-438f-b8b6-5e73e1acc341 None admin] RBAC: Authorizing `identity:get_project(project_id=f39fd5a3969c4e89ad6198892166ec4d)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:29.260610 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1daa74-c40b-438f-b8b6-5e73e1acc341 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:29.262670 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 53/108] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:29 2022] GET /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:29.268115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4e667-695d-4101-9117-f2ba1c81346c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:29.326098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:29.388217 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c44862-d8da-4c6f-9663-0736a44ed921 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:29.388520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c44862-d8da-4c6f-9663-0736a44ed921 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:29.388771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c44862-d8da-4c6f-9663-0736a44ed921 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:29.390200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 54/109] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:29.393579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4e667-695d-4101-9117-f2ba1c81346c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:29.395392 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b85bfa-5b34-41f2-9c79-079fbf900bd3 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:29.395672 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b85bfa-5b34-41f2-9c79-079fbf900bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:29.395944 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b85bfa-5b34-41f2-9c79-079fbf900bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:29.422118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-a5b85bfa-5b34-41f2-9c79-079fbf900bd3 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:29.425297 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a5b85bfa-5b34-41f2-9c79-079fbf900bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:29.475047 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d06bfb-7b98-4254-a07c-17fd4345e895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:29.475587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d06bfb-7b98-4254-a07c-17fd4345e895 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:29.475913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d06bfb-7b98-4254-a07c-17fd4345e895 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:29.476190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d06bfb-7b98-4254-a07c-17fd4345e895 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:29.476922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d06bfb-7b98-4254-a07c-17fd4345e895 None admin] RBAC: Adding query filter params (role.id=bbb7d9816b1d4ba394a847d12fbe7abf, scope.project.id=f39fd5a3969c4e89ad6198892166ec4d, user.id=5cc893e83f404c8595be758b5fbf60ff) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:29.477237 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d06bfb-7b98-4254-a07c-17fd4345e895 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:29.479248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d06bfb-7b98-4254-a07c-17fd4345e895 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:29.493199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 56/110] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:11:29 2022] GET /identity/v3/role_assignments?user.id=5cc893e83f404c8595be758b5fbf60ff&scope.project.id=f39fd5a3969c4e89ad6198892166ec4d&role.id=bbb7d9816b1d4ba394a847d12fbe7abf => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:29.496073 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940fa4b-794d-479c-a484-fef27b8ac41c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:29.496363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940fa4b-794d-479c-a484-fef27b8ac41c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:29.496638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940fa4b-794d-479c-a484-fef27b8ac41c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:29.497965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 57/111] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:29.504964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d679c8-3694-4b5b-b5d2-7a59957e355c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:29.505439 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d679c8-3694-4b5b-b5d2-7a59957e355c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:29.505730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d679c8-3694-4b5b-b5d2-7a59957e355c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:29.549413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-23d679c8-3694-4b5b-b5d2-7a59957e355c None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:29.550698 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-23d679c8-3694-4b5b-b5d2-7a59957e355c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:29.619804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 55/112] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:11:29.660057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 58/113] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:29.759779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e1d65-984f-4f76-b8ea-f2e4af97d698 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:29.760102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e1d65-984f-4f76-b8ea-f2e4af97d698 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:29.760275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e1d65-984f-4f76-b8ea-f2e4af97d698 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:29.761677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 56/114] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:29.767148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f1730-e1d5-4b39-8355-bf8ff3013f7d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:29.767443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f1730-e1d5-4b39-8355-bf8ff3013f7d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:29.767721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f1730-e1d5-4b39-8355-bf8ff3013f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:29.791206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0b5f1730-e1d5-4b39-8355-bf8ff3013f7d None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:29.793012 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0b5f1730-e1d5-4b39-8355-bf8ff3013f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:29.806454 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f8b34-87e5-42e3-98eb-8cb48b5e5c17 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:29.807602 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f8b34-87e5-42e3-98eb-8cb48b5e5c17 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:29.808083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f8b34-87e5-42e3-98eb-8cb48b5e5c17 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:29.809631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 57/115] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:11:29.816436 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072819f-a3ba-4569-9284-754e63a6d38c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:29.816968 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072819f-a3ba-4569-9284-754e63a6d38c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:29.817448 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072819f-a3ba-4569-9284-754e63a6d38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:29.839397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:29.859567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f072819f-a3ba-4569-9284-754e63a6d38c None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:29.861081 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f072819f-a3ba-4569-9284-754e63a6d38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:29.885390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 59/116] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:29.928999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:29.970881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 58/117] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:30.012526 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f1730-e1d5-4b39-8355-bf8ff3013f7d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:30.149927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f1730-e1d5-4b39-8355-bf8ff3013f7d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:30.203766 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16a32d-b1f7-409d-ab4f-ccb8e5acef54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:30.204476 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16a32d-b1f7-409d-ab4f-ccb8e5acef54 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:30.204758 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16a32d-b1f7-409d-ab4f-ccb8e5acef54 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:30.205031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16a32d-b1f7-409d-ab4f-ccb8e5acef54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:30.223053 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16a32d-b1f7-409d-ab4f-ccb8e5acef54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:30.227765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2e16a32d-b1f7-409d-ab4f-ccb8e5acef54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:30.227765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:30.227765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:30.227765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:30.227765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:30.227765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:30.227765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:30.227765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:30.227765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:30.227765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:30.227765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:30.227765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:30.227765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:30.227765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:30.227765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:30.227765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:30.228590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:30.228590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:30.228590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:30.228590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:30.228590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:30.228590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:30.228590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:30.228590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:30.228590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:30.228590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:30.228590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:30.228590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:30.228590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:30.228590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:30.228590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:30.228590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:30.229949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:30.229949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:30.229949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:30.229949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:30.229949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:30.229949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:30.229949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:30.229949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:30.229949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:30.229949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:30.229949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:30.229949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:30.229949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 60/118] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:30.236485 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072819f-a3ba-4569-9284-754e63a6d38c None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:30.240737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16a32d-b1f7-409d-ab4f-ccb8e5acef54 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:30.282548 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:30.361858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072819f-a3ba-4569-9284-754e63a6d38c None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:30.408934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16a32d-b1f7-409d-ab4f-ccb8e5acef54 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:30.417907 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cd598-182a-4c8b-add4-3a548dd844cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:30.418573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cd598-182a-4c8b-add4-3a548dd844cd None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:30.418863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cd598-182a-4c8b-add4-3a548dd844cd None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:30.419143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cd598-182a-4c8b-add4-3a548dd844cd None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:30.419832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cd598-182a-4c8b-add4-3a548dd844cd None admin] RBAC: Adding query filter params (name=member) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:30.420140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cd598-182a-4c8b-add4-3a548dd844cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:30.421536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cd598-182a-4c8b-add4-3a548dd844cd None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:30.436047 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 59/119] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:30.442227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cd598-182a-4c8b-add4-3a548dd844cd None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:30.454058 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de1274-9f6a-42d9-9bf8-6ca84e1b60d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:30.455127 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de1274-9f6a-42d9-9bf8-6ca84e1b60d4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:30.455610 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de1274-9f6a-42d9-9bf8-6ca84e1b60d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:30.456109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de1274-9f6a-42d9-9bf8-6ca84e1b60d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:30.468200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de1274-9f6a-42d9-9bf8-6ca84e1b60d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:30.473576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-44de1274-9f6a-42d9-9bf8-6ca84e1b60d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:11:30.473576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:30.473576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:30.473576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:30.473576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:30.473576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:30.473576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:30.473576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:30.473576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:30.473576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:30.473576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:30.473576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:30.473576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:30.473576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:30.473576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:30.473576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:30.474633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:30.474633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:30.474633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:30.474633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:30.474633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:30.474633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:30.474633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:30.474633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:30.474633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:30.474633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:30.474633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:30.474633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:30.474633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:30.474633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:30.474633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:30.474633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:30.475405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:30.475405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:30.475405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:30.475405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:30.475405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:30.475405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:30.475405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:30.475405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:30.475405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:30.475405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:30.475405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:11:30.475405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:30.477612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 61/120] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:11:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:11:30.478887 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de1274-9f6a-42d9-9bf8-6ca84e1b60d4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:30.481473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:30.563993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cd598-182a-4c8b-add4-3a548dd844cd None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:30.594406 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:30.606940 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de1274-9f6a-42d9-9bf8-6ca84e1b60d4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:30.607876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a1e84-83e9-4b1c-a032-1bfb8b7300b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:30.608512 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a1e84-83e9-4b1c-a032-1bfb8b7300b0 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:30.608796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a1e84-83e9-4b1c-a032-1bfb8b7300b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:30.609069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a1e84-83e9-4b1c-a032-1bfb8b7300b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:30.622603 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a1e84-83e9-4b1c-a032-1bfb8b7300b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:30.628739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-3f2a1e84-83e9-4b1c-a032-1bfb8b7300b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:30.628739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:30.628739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:30.628739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:30.628739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:30.628739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:30.628739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:30.628739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:30.628739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:30.628739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:30.628739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:30.628739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:30.628739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:30.628739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:30.628739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:30.628739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:30.629605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:30.629605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:30.629605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:30.629605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:30.629605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:30.629605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:30.629605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:30.629605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:30.629605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:30.629605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:30.629605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:30.629605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:30.629605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:30.629605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:30.629605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:30.629605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:30.631001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:30.631001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:30.631001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:30.631001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:30.631001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:30.631001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:30.631001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:30.631001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:30.631001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:30.631001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:30.631001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:30.631001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:11:30.631001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 60/121] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:11:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:30.631001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a1e84-83e9-4b1c-a032-1bfb8b7300b0 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:30.651162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb6748-5927-475c-bfa3-049868aaab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:30.652300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb6748-5927-475c-bfa3-049868aaab54 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:30.652852 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb6748-5927-475c-bfa3-049868aaab54 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:30.653418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb6748-5927-475c-bfa3-049868aaab54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:30.665403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb6748-5927-475c-bfa3-049868aaab54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:30.671153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-fdcb6748-5927-475c-bfa3-049868aaab54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:30.671153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:30.671153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:30.671153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:30.671153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:30.671153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:30.671153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:30.671153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:30.671153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:30.671153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:30.671153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:30.671153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:30.671153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:30.671153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:30.671153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:30.671153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:30.672024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:30.672024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:30.672024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:30.672024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:30.672024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:30.672024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:30.672024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:30.672024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:30.672024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:30.672024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:30.672024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:30.672024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:30.672024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:30.672024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:30.672024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:30.672024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:30.672795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:30.672795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:30.672795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:30.672795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:30.672795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:30.672795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:30.672795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:30.672795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:30.672795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:30.672795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:30.672795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:30.672795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:30.675072 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 62/122] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:30.680799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb6748-5927-475c-bfa3-049868aaab54 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:30.751269 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:30.765179 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a1e84-83e9-4b1c-a032-1bfb8b7300b0 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:30.802180 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cd9d3-fb40-40c9-b8b7-ebaa3fa3e377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:30.802818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cd9d3-fb40-40c9-b8b7-ebaa3fa3e377 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:30.803101 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cd9d3-fb40-40c9-b8b7-ebaa3fa3e377 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:30.803376 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cd9d3-fb40-40c9-b8b7-ebaa3fa3e377 None admin] PATH_INFO: `/v3/users/c194e717ca3a4063b26b04df33afe67b` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:30.804516 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cd9d3-fb40-40c9-b8b7-ebaa3fa3e377 None admin] RBAC: Authorizing `identity:get_user(user_id=c194e717ca3a4063b26b04df33afe67b)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:30.805969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599cd9d3-fb40-40c9-b8b7-ebaa3fa3e377 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:30.807698 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 61/123] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:30 2022] GET /identity/v3/users/c194e717ca3a4063b26b04df33afe67b => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:30.812524 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cd9d3-fb40-40c9-b8b7-ebaa3fa3e377 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:30.829867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb6748-5927-475c-bfa3-049868aaab54 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:30.878137 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85034e-2e76-451b-84ad-9311112b123a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:30.879597 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85034e-2e76-451b-84ad-9311112b123a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:30.880031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85034e-2e76-451b-84ad-9311112b123a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:30.880455 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85034e-2e76-451b-84ad-9311112b123a None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:30.881303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85034e-2e76-451b-84ad-9311112b123a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:30.881757 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85034e-2e76-451b-84ad-9311112b123a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:30.884162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe85034e-2e76-451b-84ad-9311112b123a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:30.895695 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 63/124] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:11:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:30.896921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85034e-2e76-451b-84ad-9311112b123a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:30.918035 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:30.934329 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cd9d3-fb40-40c9-b8b7-ebaa3fa3e377 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:30.970454 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0832e-2242-486b-9016-46dc402fd84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:30.971272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0832e-2242-486b-9016-46dc402fd84e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:30.971652 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0832e-2242-486b-9016-46dc402fd84e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:30.972020 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0832e-2242-486b-9016-46dc402fd84e None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:30.972787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0832e-2242-486b-9016-46dc402fd84e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:30.973185 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0832e-2242-486b-9016-46dc402fd84e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:30.975011 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0832e-2242-486b-9016-46dc402fd84e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:30.984355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 62/125] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:30.985765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0832e-2242-486b-9016-46dc402fd84e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:31.023845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:31.033383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe85034e-2e76-451b-84ad-9311112b123a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:31.076792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b16457-fab7-4ef0-98ab-679f220ed25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:31.077926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b16457-fab7-4ef0-98ab-679f220ed25e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:31.078490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b16457-fab7-4ef0-98ab-679f220ed25e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:31.078921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b16457-fab7-4ef0-98ab-679f220ed25e None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:31.079663 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b16457-fab7-4ef0-98ab-679f220ed25e None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:31.080088 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b16457-fab7-4ef0-98ab-679f220ed25e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:31.081976 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b16457-fab7-4ef0-98ab-679f220ed25e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:31.099494 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 64/126] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:31.106276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b16457-fab7-4ef0-98ab-679f220ed25e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:31.133340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0832e-2242-486b-9016-46dc402fd84e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:31.179865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0963095-c6ce-4735-9d44-b7533d19ca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:31.180988 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0963095-c6ce-4735-9d44-b7533d19ca6a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:31.181286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0963095-c6ce-4735-9d44-b7533d19ca6a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:31.181567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0963095-c6ce-4735-9d44-b7533d19ca6a None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:31.183570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0963095-c6ce-4735-9d44-b7533d19ca6a None admin] RBAC: Authorizing `identity:get_project(project_id=f39fd5a3969c4e89ad6198892166ec4d)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:31.185326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0963095-c6ce-4735-9d44-b7533d19ca6a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:31.191269 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 63/127] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:30 2022] GET /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:31.191269 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0963095-c6ce-4735-9d44-b7533d19ca6a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:31.192523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:31.219473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b16457-fab7-4ef0-98ab-679f220ed25e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:31.255689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04e915-5e55-4d2f-86f5-e6dd055d0527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:31.256328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04e915-5e55-4d2f-86f5-e6dd055d0527 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:31.256773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04e915-5e55-4d2f-86f5-e6dd055d0527 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:31.257411 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04e915-5e55-4d2f-86f5-e6dd055d0527 None admin] PATH_INFO: `/v3/users/c194e717ca3a4063b26b04df33afe67b` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:31.258603 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04e915-5e55-4d2f-86f5-e6dd055d0527 None admin] RBAC: Authorizing `identity:get_user(user_id=c194e717ca3a4063b26b04df33afe67b)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:31.260773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04e915-5e55-4d2f-86f5-e6dd055d0527 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:31.266128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 65/128] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:31 2022] GET /identity/v3/users/c194e717ca3a4063b26b04df33afe67b => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:31.266128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04e915-5e55-4d2f-86f5-e6dd055d0527 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:31.291238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:31.300928 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0963095-c6ce-4735-9d44-b7533d19ca6a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:31.337455 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f517e3-c70b-42ff-aa5e-ccf13cde0254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:31.338004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f517e3-c70b-42ff-aa5e-ccf13cde0254 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:31.339032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f517e3-c70b-42ff-aa5e-ccf13cde0254 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:31.339332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f517e3-c70b-42ff-aa5e-ccf13cde0254 None admin] PATH_INFO: `/v3/users/307f76b84605446ea643922d0a93ba9f` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:31.340466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f517e3-c70b-42ff-aa5e-ccf13cde0254 None admin] RBAC: Authorizing `identity:get_user(user_id=307f76b84605446ea643922d0a93ba9f)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:31.341927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f517e3-c70b-42ff-aa5e-ccf13cde0254 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:31.348451 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 64/129] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:31 2022] GET /identity/v3/users/307f76b84605446ea643922d0a93ba9f => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:31.348451 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd865a-4310-493d-ba70-b18c5737f2bf None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:31.348451 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd865a-4310-493d-ba70-b18c5737f2bf None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:31.348451 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd865a-4310-493d-ba70-b18c5737f2bf None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:31.348451 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 65/130] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:31.348451 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd865a-4310-493d-ba70-b18c5737f2bf None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:31.377641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04e915-5e55-4d2f-86f5-e6dd055d0527 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:31.416160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b4580-05f7-47f2-b4e1-a066b3f81474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:31.417897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b4580-05f7-47f2-b4e1-a066b3f81474 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:31.417897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b4580-05f7-47f2-b4e1-a066b3f81474 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:31.418241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b4580-05f7-47f2-b4e1-a066b3f81474 None admin] PATH_INFO: `/v3/users/c194e717ca3a4063b26b04df33afe67b` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:31.419642 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b4580-05f7-47f2-b4e1-a066b3f81474 None admin] RBAC: Authorizing `identity:get_user(user_id=c194e717ca3a4063b26b04df33afe67b)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:31.421053 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b4580-05f7-47f2-b4e1-a066b3f81474 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:31.422999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 66/131] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:31 2022] GET /identity/v3/users/c194e717ca3a4063b26b04df33afe67b => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:31.427651 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b4580-05f7-47f2-b4e1-a066b3f81474 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:31.441426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:31.466477 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd865a-4310-493d-ba70-b18c5737f2bf None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:31.503767 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2a216-b074-4dad-99b7-ab28cfea99b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:31.504425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2a216-b074-4dad-99b7-ab28cfea99b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:31.504785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2a216-b074-4dad-99b7-ab28cfea99b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:31.504971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2a216-b074-4dad-99b7-ab28cfea99b2 None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d/users/c194e717ca3a4063b26b04df33afe67b/roles/8e4aa52bcd2a47389ee1c5de44fa28ca` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:31.507119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2a216-b074-4dad-99b7-ab28cfea99b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f39fd5a3969c4e89ad6198892166ec4d, user_id=c194e717ca3a4063b26b04df33afe67b, role_id=8e4aa52bcd2a47389ee1c5de44fa28ca)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:31.508556 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2a216-b074-4dad-99b7-ab28cfea99b2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:31.534104 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 66/132] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:11:31 2022] PUT /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d/users/c194e717ca3a4063b26b04df33afe67b/roles/8e4aa52bcd2a47389ee1c5de44fa28ca => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:11:31.534104 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2a216-b074-4dad-99b7-ab28cfea99b2 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:31.553244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b4580-05f7-47f2-b4e1-a066b3f81474 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:31.562657 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:31.598686 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c7cab-e557-431d-98a0-c157f8b9cbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:31.599449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c7cab-e557-431d-98a0-c157f8b9cbdd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:31.599859 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c7cab-e557-431d-98a0-c157f8b9cbdd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:31.600209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c7cab-e557-431d-98a0-c157f8b9cbdd None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:31.601799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c7cab-e557-431d-98a0-c157f8b9cbdd None admin] RBAC: Authorizing `identity:get_project(project_id=f39fd5a3969c4e89ad6198892166ec4d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:31.603556 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c7cab-e557-431d-98a0-c157f8b9cbdd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:31.610194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 67/133] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:31 2022] GET /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:31.611978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5080e-c0ce-4192-9fd1-cac611d3a3bd None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:31.612343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5080e-c0ce-4192-9fd1-cac611d3a3bd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:31.612811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5080e-c0ce-4192-9fd1-cac611d3a3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:31.635879 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-31a5080e-c0ce-4192-9fd1-cac611d3a3bd None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:31.637320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-31a5080e-c0ce-4192-9fd1-cac611d3a3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:31.667227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2a216-b074-4dad-99b7-ab28cfea99b2 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:31.713855 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34486803-4a07-4163-97c9-e5f6c8995860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:31.714539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34486803-4a07-4163-97c9-e5f6c8995860 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:31.715188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34486803-4a07-4163-97c9-e5f6c8995860 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:31.715188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34486803-4a07-4163-97c9-e5f6c8995860 None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:31.716240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34486803-4a07-4163-97c9-e5f6c8995860 None admin] RBAC: Authorizing `identity:get_project(project_id=f39fd5a3969c4e89ad6198892166ec4d)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:31.717783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34486803-4a07-4163-97c9-e5f6c8995860 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:31.719892 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 67/134] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:31 2022] GET /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:31.721112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34486803-4a07-4163-97c9-e5f6c8995860 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:31.733285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 68/135] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:31.733902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5080e-c0ce-4192-9fd1-cac611d3a3bd None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:31.745588 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:31.855433 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5080e-c0ce-4192-9fd1-cac611d3a3bd None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:31.886225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:31.894631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5920db1-b456-4c69-865f-00b078a0db39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:31.895404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5920db1-b456-4c69-865f-00b078a0db39 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:31.895692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5920db1-b456-4c69-865f-00b078a0db39 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:31.896256 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5920db1-b456-4c69-865f-00b078a0db39 None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d/users/c194e717ca3a4063b26b04df33afe67b/roles/41d658f3417e4e48b117d57120991ad8` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:31.898585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5920db1-b456-4c69-865f-00b078a0db39 None admin] RBAC: Authorizing `identity:create_grant(project_id=f39fd5a3969c4e89ad6198892166ec4d, user_id=c194e717ca3a4063b26b04df33afe67b, role_id=41d658f3417e4e48b117d57120991ad8)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:31.900202 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5920db1-b456-4c69-865f-00b078a0db39 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:31.912158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34486803-4a07-4163-97c9-e5f6c8995860 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:31.917634 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 69/136] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:11:31 2022] PUT /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d/users/c194e717ca3a4063b26b04df33afe67b/roles/41d658f3417e4e48b117d57120991ad8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:11:31.918384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5920db1-b456-4c69-865f-00b078a0db39 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:31.953025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888cc38-e5fd-4f9b-b318-05cc63b79b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:31.954018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888cc38-e5fd-4f9b-b318-05cc63b79b74 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:31.954357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888cc38-e5fd-4f9b-b318-05cc63b79b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:31.955013 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888cc38-e5fd-4f9b-b318-05cc63b79b74 None admin] PATH_INFO: `/v3/projects/9a26874f45bb48e589edbfb3370f51a6` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:31.956435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888cc38-e5fd-4f9b-b318-05cc63b79b74 None admin] RBAC: Authorizing `identity:get_project(project_id=9a26874f45bb48e589edbfb3370f51a6)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:31.958236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888cc38-e5fd-4f9b-b318-05cc63b79b74 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:31.961226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 68/137] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:31 2022] GET /identity/v3/projects/9a26874f45bb48e589edbfb3370f51a6 => generated 312 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:31.962422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae54d23-f85c-4440-b741-5c8b8a19f508 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:31.962711 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae54d23-f85c-4440-b741-5c8b8a19f508 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:31.963603 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae54d23-f85c-4440-b741-5c8b8a19f508 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:31.964987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 69/138] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:31.971216 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1b498-1427-46e2-a013-7b17c4caa175 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:31.971516 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1b498-1427-46e2-a013-7b17c4caa175 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:31.971849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1b498-1427-46e2-a013-7b17c4caa175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:32.017638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f4d1b498-1427-46e2-a013-7b17c4caa175 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:32.018987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f4d1b498-1427-46e2-a013-7b17c4caa175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:32.040099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:32.114112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5920db1-b456-4c69-865f-00b078a0db39 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:32.126411 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 70/139] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:32.129895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1b498-1427-46e2-a013-7b17c4caa175 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:32.171841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814af3b-338e-4b74-9e48-84936834c45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:32.172521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814af3b-338e-4b74-9e48-84936834c45d None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:32.172804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814af3b-338e-4b74-9e48-84936834c45d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:32.173078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814af3b-338e-4b74-9e48-84936834c45d None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d/users/307f76b84605446ea643922d0a93ba9f/roles/8de0c87242d7426ea25a510b578c02aa` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:32.183358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814af3b-338e-4b74-9e48-84936834c45d None admin] RBAC: Authorizing `identity:create_grant(project_id=f39fd5a3969c4e89ad6198892166ec4d, user_id=307f76b84605446ea643922d0a93ba9f, role_id=8de0c87242d7426ea25a510b578c02aa)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:32.184856 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6814af3b-338e-4b74-9e48-84936834c45d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:32.208821 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 70/140] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:11:31 2022] PUT /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d/users/307f76b84605446ea643922d0a93ba9f/roles/8de0c87242d7426ea25a510b578c02aa => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:11:32.209427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814af3b-338e-4b74-9e48-84936834c45d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:32.289824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:32.310537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1b498-1427-46e2-a013-7b17c4caa175 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:32.430905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4587c-4316-485c-a01f-7ad36f08fa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:32.431523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4587c-4316-485c-a01f-7ad36f08fa19 None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:32.431843 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4587c-4316-485c-a01f-7ad36f08fa19 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:32.432319 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4587c-4316-485c-a01f-7ad36f08fa19 None admin] PATH_INFO: `/v3/projects/9a26874f45bb48e589edbfb3370f51a6/users/c194e717ca3a4063b26b04df33afe67b/roles/8e4aa52bcd2a47389ee1c5de44fa28ca` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:32.438931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4587c-4316-485c-a01f-7ad36f08fa19 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a26874f45bb48e589edbfb3370f51a6, user_id=c194e717ca3a4063b26b04df33afe67b, role_id=8e4aa52bcd2a47389ee1c5de44fa28ca)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:32.440435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4587c-4316-485c-a01f-7ad36f08fa19 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:32.461792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 71/141] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:11:32 2022] PUT /identity/v3/projects/9a26874f45bb48e589edbfb3370f51a6/users/c194e717ca3a4063b26b04df33afe67b/roles/8e4aa52bcd2a47389ee1c5de44fa28ca => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:11:32.467222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6814af3b-338e-4b74-9e48-84936834c45d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:32.489104 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4587c-4316-485c-a01f-7ad36f08fa19 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:32.508605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:32.519791 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25cd01-9315-47e9-9f21-71927596f496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:32.520457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25cd01-9315-47e9-9f21-71927596f496 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:32.520778 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25cd01-9315-47e9-9f21-71927596f496 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:32.521056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25cd01-9315-47e9-9f21-71927596f496 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:32.522320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25cd01-9315-47e9-9f21-71927596f496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:32.523929 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25cd01-9315-47e9-9f21-71927596f496 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:32.526360 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 71/142] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:32.532078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25cd01-9315-47e9-9f21-71927596f496 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:32.674618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4587c-4316-485c-a01f-7ad36f08fa19 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:32.716836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25cd01-9315-47e9-9f21-71927596f496 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:32.749670 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860dcc8-e472-441c-af9a-d366b55f809b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:32.750352 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860dcc8-e472-441c-af9a-d366b55f809b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:32.750640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860dcc8-e472-441c-af9a-d366b55f809b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:32.750919 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860dcc8-e472-441c-af9a-d366b55f809b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:32.763471 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860dcc8-e472-441c-af9a-d366b55f809b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:32.769139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-3860dcc8-e472-441c-af9a-d366b55f809b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:11:32.769139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:32.769139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:32.769139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:32.769139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:32.769139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:32.769139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:32.769139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:32.769139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:32.769139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:32.769139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:32.769139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:32.769139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:32.769139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:32.769139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:32.769139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:32.769989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:32.769989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:32.769989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:32.769989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:32.769989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:32.769989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:32.769989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:32.769989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:32.769989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:32.769989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:32.769989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:32.769989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:32.769989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:32.769989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:32.769989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:32.769989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:32.770800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:32.770800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:32.770800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:32.770800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:32.770800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:32.770800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:32.770800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:32.770800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:32.770800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:32.770800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:32.770800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:11:32.770800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:11:32.770800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 72/143] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:32.781950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860dcc8-e472-441c-af9a-d366b55f809b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:32.783661 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcd84e-f722-4ca9-aa59-f8037c7e68c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:32.784291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcd84e-f722-4ca9-aa59-f8037c7e68c5 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:32.784624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcd84e-f722-4ca9-aa59-f8037c7e68c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:32.784847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fcd84e-f722-4ca9-aa59-f8037c7e68c5 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:32.785499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcd84e-f722-4ca9-aa59-f8037c7e68c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:32.787199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fcd84e-f722-4ca9-aa59-f8037c7e68c5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:32.794348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:32.823545 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 72/144] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 16:11:32 2022] POST /identity/v3/users => generated 283 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:11:32.971939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860dcc8-e472-441c-af9a-d366b55f809b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:33.033895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30052e5d-d915-48e5-a917-bc063fb08f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:33.034563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30052e5d-d915-48e5-a917-bc063fb08f2a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:33.034842 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30052e5d-d915-48e5-a917-bc063fb08f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:33.035123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30052e5d-d915-48e5-a917-bc063fb08f2a None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:33.035809 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30052e5d-d915-48e5-a917-bc063fb08f2a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:33.036119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30052e5d-d915-48e5-a917-bc063fb08f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:33.037529 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30052e5d-d915-48e5-a917-bc063fb08f2a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:33.050099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 73/145] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:33.055386 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcd84e-f722-4ca9-aa59-f8037c7e68c5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:33.134461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:33.195140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fcd84e-f722-4ca9-aa59-f8037c7e68c5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:33.239658 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c4150-3861-472c-976d-051c8a5c9ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:33.240223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c4150-3861-472c-976d-051c8a5c9ddb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:33.240504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c4150-3861-472c-976d-051c8a5c9ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:33.240777 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c4150-3861-472c-976d-051c8a5c9ddb None admin] PATH_INFO: `/v3/users/5cc893e83f404c8595be758b5fbf60ff` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:33.241932 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c4150-3861-472c-976d-051c8a5c9ddb None admin] RBAC: Authorizing `identity:get_user(user_id=5cc893e83f404c8595be758b5fbf60ff)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:33.243428 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c4150-3861-472c-976d-051c8a5c9ddb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:33.245944 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 73/146] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:33 2022] GET /identity/v3/users/5cc893e83f404c8595be758b5fbf60ff => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:33.251283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30052e5d-d915-48e5-a917-bc063fb08f2a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:33.361803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:33.402688 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30052e5d-d915-48e5-a917-bc063fb08f2a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:33.451727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb47c45-8eac-4d5e-9d9c-7b4f416ae0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:33.452389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb47c45-8eac-4d5e-9d9c-7b4f416ae0d9 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:33.452683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb47c45-8eac-4d5e-9d9c-7b4f416ae0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:33.453005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb47c45-8eac-4d5e-9d9c-7b4f416ae0d9 None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:33.454136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb47c45-8eac-4d5e-9d9c-7b4f416ae0d9 None admin] RBAC: Authorizing `identity:get_project(project_id=f39fd5a3969c4e89ad6198892166ec4d)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:33.455620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb47c45-8eac-4d5e-9d9c-7b4f416ae0d9 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:33.457429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 74/147] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:33 2022] GET /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:33.463641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c4150-3861-472c-976d-051c8a5c9ddb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:33.580291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c4150-3861-472c-976d-051c8a5c9ddb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:33.605168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:33.625138 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8908668-176a-47ee-9209-2054ea1d6cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:33.625811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8908668-176a-47ee-9209-2054ea1d6cc2 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:33.626114 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8908668-176a-47ee-9209-2054ea1d6cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:33.626400 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8908668-176a-47ee-9209-2054ea1d6cc2 None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d/users/5cc893e83f404c8595be758b5fbf60ff/roles/bbb7d9816b1d4ba394a847d12fbe7abf` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:33.628425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8908668-176a-47ee-9209-2054ea1d6cc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f39fd5a3969c4e89ad6198892166ec4d, user_id=5cc893e83f404c8595be758b5fbf60ff, role_id=bbb7d9816b1d4ba394a847d12fbe7abf)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:33.629879 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8908668-176a-47ee-9209-2054ea1d6cc2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:33.660527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 74/148] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:11:33 2022] PUT /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d/users/5cc893e83f404c8595be758b5fbf60ff/roles/bbb7d9816b1d4ba394a847d12fbe7abf => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:11:34.176261 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540c843-150e-4e6a-90ee-b4286abace97 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:34.176762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540c843-150e-4e6a-90ee-b4286abace97 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:34.176835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540c843-150e-4e6a-90ee-b4286abace97 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:34.178167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 75/149] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:34.196067 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b783a62-df69-4cc5-8ce6-6900e24073c4 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:34.196364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b783a62-df69-4cc5-8ce6-6900e24073c4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:34.196630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b783a62-df69-4cc5-8ce6-6900e24073c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:34.223074 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3b783a62-df69-4cc5-8ce6-6900e24073c4 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:34.224282 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3b783a62-df69-4cc5-8ce6-6900e24073c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:34.305989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367117b-e7a6-4a2e-a35d-41ff9b692ca5 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:34.306287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367117b-e7a6-4a2e-a35d-41ff9b692ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:34.306563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367117b-e7a6-4a2e-a35d-41ff9b692ca5 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:34.308728 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 76/150] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:11:34.319636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 75/151] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:34.326175 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf17b9b-424d-4073-be9f-a9628d173e76 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:34.326467 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf17b9b-424d-4073-be9f-a9628d173e76 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:34.326746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf17b9b-424d-4073-be9f-a9628d173e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:34.351195 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-5bf17b9b-424d-4073-be9f-a9628d173e76 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:34.352404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5bf17b9b-424d-4073-be9f-a9628d173e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:34.435809 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 77/152] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:34.806812 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b783a62-df69-4cc5-8ce6-6900e24073c4 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:34.918564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b783a62-df69-4cc5-8ce6-6900e24073c4 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:34.932210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:34.958719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e792173-b969-4b07-ae40-29fd2e4eca9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:34.959358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e792173-b969-4b07-ae40-29fd2e4eca9e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:34.959634 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e792173-b969-4b07-ae40-29fd2e4eca9e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:34.959963 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e792173-b969-4b07-ae40-29fd2e4eca9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:34.975608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e792173-b969-4b07-ae40-29fd2e4eca9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:34.980816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-7e792173-b969-4b07-ae40-29fd2e4eca9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:11:34.980816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:34.980816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:34.980816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:34.980816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:34.980816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:34.980816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:34.980816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:34.980816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:34.980816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:34.980816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:34.980816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:34.980816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:34.980816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:34.980816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:34.980816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:34.983197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:34.983197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:34.983197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:34.983197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:34.983197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:34.983197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:34.983197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:34.983197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:34.983197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:34.983197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:34.983197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:34.983197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:34.983197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:34.983197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:34.983197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:34.983197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:34.985158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:34.985158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:34.985158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:34.985158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:34.985158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:34.985158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:34.985158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:34.985158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:34.985158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:34.985158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:34.985158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:11:34.985158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:34.985158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 76/153] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:11:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:34.992620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf17b9b-424d-4073-be9f-a9628d173e76 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:35.085793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e792173-b969-4b07-ae40-29fd2e4eca9e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:35.092988 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:35.143591 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf17b9b-424d-4073-be9f-a9628d173e76 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:35.205877 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0311ec3-e3ff-4f82-97ab-f8afbc47dca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:35.206669 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0311ec3-e3ff-4f82-97ab-f8afbc47dca8 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:35.206835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0311ec3-e3ff-4f82-97ab-f8afbc47dca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:35.207221 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0311ec3-e3ff-4f82-97ab-f8afbc47dca8 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:35.207910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0311ec3-e3ff-4f82-97ab-f8afbc47dca8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:35.208217 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0311ec3-e3ff-4f82-97ab-f8afbc47dca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:35.209603 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0311ec3-e3ff-4f82-97ab-f8afbc47dca8 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:35.222481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 78/154] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:11:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:35.228332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0311ec3-e3ff-4f82-97ab-f8afbc47dca8 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:35.279626 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e792173-b969-4b07-ae40-29fd2e4eca9e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:35.351076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd111c18-8eb8-4510-90de-9e595e1b498c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:35.351634 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111c18-8eb8-4510-90de-9e595e1b498c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:35.351907 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111c18-8eb8-4510-90de-9e595e1b498c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:35.352173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111c18-8eb8-4510-90de-9e595e1b498c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:35.378927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd111c18-8eb8-4510-90de-9e595e1b498c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:35.391132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-fd111c18-8eb8-4510-90de-9e595e1b498c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:35.391132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:35.391132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:35.391132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:35.391132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:35.391132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:35.391132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:35.391132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:35.391132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:35.391132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:35.391132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:35.391132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:35.391132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:35.391132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:35.391132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:35.391132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:35.393542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:35.393542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:35.393542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:35.393542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:35.393542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:35.393542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:35.393542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:35.393542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:35.393542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:35.393542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:35.393542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:35.393542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:35.393542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:35.393542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:35.393542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:35.393542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:35.395676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:35.395676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:35.395676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:35.395676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:35.395676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:35.395676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:35.395676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:35.395676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:35.395676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:35.395676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:35.395676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:35.395676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:35.395676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 77/155] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:35.402098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd111c18-8eb8-4510-90de-9e595e1b498c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:35.447365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:35.451897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0311ec3-e3ff-4f82-97ab-f8afbc47dca8 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:35.495805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:35.515605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa952fd-18cc-409b-b53a-dc563cface77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:35.517144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa952fd-18cc-409b-b53a-dc563cface77 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:35.517144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa952fd-18cc-409b-b53a-dc563cface77 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:35.517144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa952fd-18cc-409b-b53a-dc563cface77 None admin] PATH_INFO: `/v3/users/c194e717ca3a4063b26b04df33afe67b` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:35.522777 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa952fd-18cc-409b-b53a-dc563cface77 None admin] RBAC: Authorizing `identity:get_user(user_id=c194e717ca3a4063b26b04df33afe67b)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:35.524248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa952fd-18cc-409b-b53a-dc563cface77 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:35.526772 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 79/156] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:35 2022] GET /identity/v3/users/c194e717ca3a4063b26b04df33afe67b => generated 275 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:35.532152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa952fd-18cc-409b-b53a-dc563cface77 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:35.566518 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd111c18-8eb8-4510-90de-9e595e1b498c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:35.641126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67e86a-0472-4343-84f2-9a21f6612b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:35.641663 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67e86a-0472-4343-84f2-9a21f6612b51 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:35.641943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67e86a-0472-4343-84f2-9a21f6612b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:35.642319 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67e86a-0472-4343-84f2-9a21f6612b51 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:35.642997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67e86a-0472-4343-84f2-9a21f6612b51 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:35.643300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67e86a-0472-4343-84f2-9a21f6612b51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:35.644683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67e86a-0472-4343-84f2-9a21f6612b51 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:35.663666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 78/157] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:35.671660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67e86a-0472-4343-84f2-9a21f6612b51 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:35.706338 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa952fd-18cc-409b-b53a-dc563cface77 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:35.750200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b93614-e0d0-4530-98a0-3b9175f231d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:35.751238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b93614-e0d0-4530-98a0-3b9175f231d4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:35.751720 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b93614-e0d0-4530-98a0-3b9175f231d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:35.752201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b93614-e0d0-4530-98a0-3b9175f231d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:35.828591 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:35.836483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b93614-e0d0-4530-98a0-3b9175f231d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:35.839104 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b93614-e0d0-4530-98a0-3b9175f231d4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:35.996318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:36.016818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 80/158] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 16:11:36.018146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108179a-a246-4c43-9b15-f3f1af430e91 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:36.018442 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108179a-a246-4c43-9b15-f3f1af430e91 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:36.018719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108179a-a246-4c43-9b15-f3f1af430e91 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:36.020238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 81/159] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:36.021439 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574e456-46b4-41e1-a45b-3ab4a7970f3b None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:36.021722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574e456-46b4-41e1-a45b-3ab4a7970f3b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:36.021994 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574e456-46b4-41e1-a45b-3ab4a7970f3b None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:36.028111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 82/160] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:36.028817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574e456-46b4-41e1-a45b-3ab4a7970f3b None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:36.040031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67e86a-0472-4343-84f2-9a21f6612b51 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:36.146896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fcb41d-afea-4411-86ea-1693ef8d72e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:36.147567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcb41d-afea-4411-86ea-1693ef8d72e2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:36.147854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcb41d-afea-4411-86ea-1693ef8d72e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:36.148139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fcb41d-afea-4411-86ea-1693ef8d72e2 None admin] PATH_INFO: `/v3/users/c194e717ca3a4063b26b04df33afe67b` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:36.149397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcb41d-afea-4411-86ea-1693ef8d72e2 None admin] RBAC: Authorizing `identity:get_user(user_id=c194e717ca3a4063b26b04df33afe67b)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:36.151080 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fcb41d-afea-4411-86ea-1693ef8d72e2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:36.153314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 79/161] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:35 2022] GET /identity/v3/users/c194e717ca3a4063b26b04df33afe67b => generated 275 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:36.154396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8aee87-dbcf-40dc-b7bb-c18807a00644 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:36.154683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8aee87-dbcf-40dc-b7bb-c18807a00644 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:36.154962 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8aee87-dbcf-40dc-b7bb-c18807a00644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:36.215123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8e8aee87-dbcf-40dc-b7bb-c18807a00644 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:36.216334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8e8aee87-dbcf-40dc-b7bb-c18807a00644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:36.241353 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:36.246722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574e456-46b4-41e1-a45b-3ab4a7970f3b None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:36.303870 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25516a94-37e9-4cf9-8cde-b31b875566a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:36.304506 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25516a94-37e9-4cf9-8cde-b31b875566a6 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:36.304783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25516a94-37e9-4cf9-8cde-b31b875566a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:36.305051 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25516a94-37e9-4cf9-8cde-b31b875566a6 None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:36.306189 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25516a94-37e9-4cf9-8cde-b31b875566a6 None admin] RBAC: Authorizing `identity:get_project(project_id=f39fd5a3969c4e89ad6198892166ec4d)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:36.307925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25516a94-37e9-4cf9-8cde-b31b875566a6 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:36.310354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 83/162] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:36 2022] GET /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:36.311619 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea0b09-0720-4f54-96c9-c6b6dceb6c4f None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:36.311899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea0b09-0720-4f54-96c9-c6b6dceb6c4f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:36.312214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea0b09-0720-4f54-96c9-c6b6dceb6c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:36.345008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-48ea0b09-0720-4f54-96c9-c6b6dceb6c4f None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:36.349657 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-48ea0b09-0720-4f54-96c9-c6b6dceb6c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:36.415380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 80/163] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:36.416807 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8aee87-dbcf-40dc-b7bb-c18807a00644 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:36.472509 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 84/164] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:36.473382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea0b09-0720-4f54-96c9-c6b6dceb6c4f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:36.553162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:36.567571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8aee87-dbcf-40dc-b7bb-c18807a00644 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:36.618787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f2ddc-016f-4669-8c2b-c7128a552908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:36.619994 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f2ddc-016f-4669-8c2b-c7128a552908 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:36.620273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f2ddc-016f-4669-8c2b-c7128a552908 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:36.620550 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f2ddc-016f-4669-8c2b-c7128a552908 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:36.649142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:36.661739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea0b09-0720-4f54-96c9-c6b6dceb6c4f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:36.735696 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a6e7c-792a-41b7-96a7-5252c31e1f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:36.736317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a6e7c-792a-41b7-96a7-5252c31e1f61 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:36.736596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a6e7c-792a-41b7-96a7-5252c31e1f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:36.736876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a6e7c-792a-41b7-96a7-5252c31e1f61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:36.737613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a6e7c-792a-41b7-96a7-5252c31e1f61 None admin] RBAC: Adding query filter params (role.id=41d658f3417e4e48b117d57120991ad8, scope.project.id=f39fd5a3969c4e89ad6198892166ec4d, user.id=c194e717ca3a4063b26b04df33afe67b) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:36.737923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a6e7c-792a-41b7-96a7-5252c31e1f61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:36.739407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a6e7c-792a-41b7-96a7-5252c31e1f61 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:36.750793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 85/165] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:11:36 2022] GET /identity/v3/role_assignments?user.id=c194e717ca3a4063b26b04df33afe67b&scope.project.id=f39fd5a3969c4e89ad6198892166ec4d&role.id=41d658f3417e4e48b117d57120991ad8 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:36.758656 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f2ddc-016f-4669-8c2b-c7128a552908 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:36.760227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f2ddc-016f-4669-8c2b-c7128a552908 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:36.872593 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:36.886385 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 81/166] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:11:36.895337 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a6e7c-792a-41b7-96a7-5252c31e1f61 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:37.023447 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a6e7c-792a-41b7-96a7-5252c31e1f61 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:37.067889 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d55009-007c-49bf-b25b-df57dfcef7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:37.068587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d55009-007c-49bf-b25b-df57dfcef7cb None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:37.068873 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d55009-007c-49bf-b25b-df57dfcef7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:37.069149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d55009-007c-49bf-b25b-df57dfcef7cb None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:37.070431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d55009-007c-49bf-b25b-df57dfcef7cb None admin] RBAC: Authorizing `identity:get_project(project_id=f39fd5a3969c4e89ad6198892166ec4d)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:37.071951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d55009-007c-49bf-b25b-df57dfcef7cb None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:37.074249 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 86/167] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:36 2022] GET /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:37.082610 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f2ddc-016f-4669-8c2b-c7128a552908 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:37.120032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d55009-007c-49bf-b25b-df57dfcef7cb None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:37.184462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:37.257278 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f2ddc-016f-4669-8c2b-c7128a552908 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:37.311388 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989958d2-a1d1-482b-874f-f7a4991f1b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:37.312019 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989958d2-a1d1-482b-874f-f7a4991f1b48 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:37.312304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989958d2-a1d1-482b-874f-f7a4991f1b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:37.312583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989958d2-a1d1-482b-874f-f7a4991f1b48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:37.313432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989958d2-a1d1-482b-874f-f7a4991f1b48 None admin] RBAC: Adding query filter params (role.id=8e4aa52bcd2a47389ee1c5de44fa28ca, scope.project.id=f39fd5a3969c4e89ad6198892166ec4d, user.id=c194e717ca3a4063b26b04df33afe67b) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:37.313801 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989958d2-a1d1-482b-874f-f7a4991f1b48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:37.315304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989958d2-a1d1-482b-874f-f7a4991f1b48 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:37.331847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 82/168] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:11:37 2022] GET /identity/v3/role_assignments?user.id=c194e717ca3a4063b26b04df33afe67b&scope.project.id=f39fd5a3969c4e89ad6198892166ec4d&role.id=8e4aa52bcd2a47389ee1c5de44fa28ca => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:37.332711 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989958d2-a1d1-482b-874f-f7a4991f1b48 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:37.353228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d55009-007c-49bf-b25b-df57dfcef7cb None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:37.433463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:37.446970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d529e91-0af9-4232-9b32-8eb01fe5c5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:37.448206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d529e91-0af9-4232-9b32-8eb01fe5c5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:37.448488 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d529e91-0af9-4232-9b32-8eb01fe5c5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:37.448759 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d529e91-0af9-4232-9b32-8eb01fe5c5b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:37.471116 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d529e91-0af9-4232-9b32-8eb01fe5c5b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:37.476533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-3d529e91-0af9-4232-9b32-8eb01fe5c5b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:37.476533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:37.476533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:37.476533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:37.476533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:37.476533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:37.476533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:37.476533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:37.476533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:37.476533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:37.476533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:37.476533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:37.476533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:37.476533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:37.476533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:37.476533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:37.477677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:37.477677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:37.477677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:37.477677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:37.477677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:37.477677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:37.477677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:37.477677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:37.477677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:37.477677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:37.477677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:37.477677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:37.477677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:37.477677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:37.477677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:37.477677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:37.479895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:37.479895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:37.479895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:37.479895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:37.479895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:37.479895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:37.479895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:37.479895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:37.479895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:37.479895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:37.479895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:37.479895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:11:37.479895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 87/169] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:11:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:11:37.483885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d529e91-0af9-4232-9b32-8eb01fe5c5b2 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:37.527484 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989958d2-a1d1-482b-874f-f7a4991f1b48 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:37.569261 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cf00b-f66f-4b58-aeba-71f6765e0cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:37.569929 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cf00b-f66f-4b58-aeba-71f6765e0cde None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:37.570241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cf00b-f66f-4b58-aeba-71f6765e0cde None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:37.570702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cf00b-f66f-4b58-aeba-71f6765e0cde None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:37.584790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cf00b-f66f-4b58-aeba-71f6765e0cde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:37.592000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e08cf00b-f66f-4b58-aeba-71f6765e0cde None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:37.592000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:37.592000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:37.592000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:37.592000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:37.592000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:37.592000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:37.592000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:37.592000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:37.592000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:37.592000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:37.592000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:37.592000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:37.592000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:37.592000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:37.592000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:37.594304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:37.594304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:37.594304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:37.594304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:37.594304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:37.594304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:37.594304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:37.594304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:37.594304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:37.594304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:37.594304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:37.594304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:37.594304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:37.594304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:37.594304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:37.594304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:37.596310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:37.596310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:37.596310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:37.596310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:37.596310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:37.596310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:37.596310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:37.596310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:37.596310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:37.596310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:37.596310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:37.596310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:37.596310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 83/170] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:37.596310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c95c-091c-4716-abe4-9c62d901f145 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:37.601735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c95c-091c-4716-abe4-9c62d901f145 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:37.601735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92c95c-091c-4716-abe4-9c62d901f145 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:37.601735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 84/171] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:37.602661 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92c95c-091c-4716-abe4-9c62d901f145 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:37.651172 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:37.682196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d529e91-0af9-4232-9b32-8eb01fe5c5b2 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:37.749683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa6e8d-334b-4bde-8122-f0d19dea3541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:37.750238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa6e8d-334b-4bde-8122-f0d19dea3541 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:37.750521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa6e8d-334b-4bde-8122-f0d19dea3541 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:37.750795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa6e8d-334b-4bde-8122-f0d19dea3541 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:37.751476 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa6e8d-334b-4bde-8122-f0d19dea3541 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:37.751777 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa6e8d-334b-4bde-8122-f0d19dea3541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:37.753411 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa6e8d-334b-4bde-8122-f0d19dea3541 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:37.768052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92c95c-091c-4716-abe4-9c62d901f145 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:37.772667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 88/172] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:37.783203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43117ebf-8186-4fb4-843d-60b43955b876 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:37.783552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43117ebf-8186-4fb4-843d-60b43955b876 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:37.783838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43117ebf-8186-4fb4-843d-60b43955b876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:37.803406 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:37.814946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-43117ebf-8186-4fb4-843d-60b43955b876 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:37.816164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-43117ebf-8186-4fb4-843d-60b43955b876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:37.841246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12155b2-4782-437b-8a86-31e36677f7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:37.841863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12155b2-4782-437b-8a86-31e36677f7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:37.842166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12155b2-4782-437b-8a86-31e36677f7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:37.842440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12155b2-4782-437b-8a86-31e36677f7a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:37.843116 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12155b2-4782-437b-8a86-31e36677f7a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:37.843419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12155b2-4782-437b-8a86-31e36677f7a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:37.846363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12155b2-4782-437b-8a86-31e36677f7a9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:37.859352 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 85/173] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:37.859996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12155b2-4782-437b-8a86-31e36677f7a9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:37.920566 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 89/174] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:37.921434 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43117ebf-8186-4fb4-843d-60b43955b876 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:37.988128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12155b2-4782-437b-8a86-31e36677f7a9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:38.010968 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:38.036340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663858d-50f5-4854-a11d-787fdc22ef10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:38.037661 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43117ebf-8186-4fb4-843d-60b43955b876 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:38.037782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663858d-50f5-4854-a11d-787fdc22ef10 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:38.038002 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663858d-50f5-4854-a11d-787fdc22ef10 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:38.038303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663858d-50f5-4854-a11d-787fdc22ef10 None admin] PATH_INFO: `/v3/users/307f76b84605446ea643922d0a93ba9f` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:38.039500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663858d-50f5-4854-a11d-787fdc22ef10 None admin] RBAC: Authorizing `identity:get_user(user_id=307f76b84605446ea643922d0a93ba9f)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:38.041678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663858d-50f5-4854-a11d-787fdc22ef10 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:38.044793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 86/175] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:37 2022] GET /identity/v3/users/307f76b84605446ea643922d0a93ba9f => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:38.046653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8aae7-48e1-44d9-b59e-cf646fd4723b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:38.047165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8aae7-48e1-44d9-b59e-cf646fd4723b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:38.047673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8aae7-48e1-44d9-b59e-cf646fd4723b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:38.049361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 87/176] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:38.050418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9103c-b1ae-4f46-970f-b2ba599ca761 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:38.050697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9103c-b1ae-4f46-970f-b2ba599ca761 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:38.050979 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9103c-b1ae-4f46-970f-b2ba599ca761 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:38.052207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 88/177] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:38.053214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59609b7-4c79-49bb-a462-c46e77f14332 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:38.053491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59609b7-4c79-49bb-a462-c46e77f14332 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:38.053743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59609b7-4c79-49bb-a462-c46e77f14332 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:38.055175 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 89/178] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:38.055883 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59609b7-4c79-49bb-a462-c46e77f14332 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:38.079849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e258991-3231-4486-9213-f07de594dc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:38.080485 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e258991-3231-4486-9213-f07de594dc99 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:38.080766 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e258991-3231-4486-9213-f07de594dc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:38.081040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e258991-3231-4486-9213-f07de594dc99 None admin] PATH_INFO: `/v3/users/c194e717ca3a4063b26b04df33afe67b` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:38.082616 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e258991-3231-4486-9213-f07de594dc99 None admin] RBAC: Authorizing `identity:get_user(user_id=c194e717ca3a4063b26b04df33afe67b)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:38.084499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e258991-3231-4486-9213-f07de594dc99 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:38.086891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 90/179] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:37 2022] GET /identity/v3/users/c194e717ca3a4063b26b04df33afe67b => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:38.091350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84825e29-8567-4d24-87f5-14f993de3693 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:38.091637 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84825e29-8567-4d24-87f5-14f993de3693 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:38.091913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84825e29-8567-4d24-87f5-14f993de3693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:38.109911 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-84825e29-8567-4d24-87f5-14f993de3693 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:38.111155 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-84825e29-8567-4d24-87f5-14f993de3693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:38.115109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:38.180897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59609b7-4c79-49bb-a462-c46e77f14332 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:38.186059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 91/180] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:38.191144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dd1b3-fc49-4338-af35-435af77a5d79 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:38.192077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dd1b3-fc49-4338-af35-435af77a5d79 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:38.192537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612dd1b3-fc49-4338-af35-435af77a5d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:38.217171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-612dd1b3-fc49-4338-af35-435af77a5d79 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:38.218677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-612dd1b3-fc49-4338-af35-435af77a5d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:38.218834 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a189ef-2cc6-463d-a63d-8c82fbcf8b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:38.219619 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a189ef-2cc6-463d-a63d-8c82fbcf8b94 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:38.219965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a189ef-2cc6-463d-a63d-8c82fbcf8b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:38.220302 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a189ef-2cc6-463d-a63d-8c82fbcf8b94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:38.289168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a189ef-2cc6-463d-a63d-8c82fbcf8b94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:38.290273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 92/181] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:38.290574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a189ef-2cc6-463d-a63d-8c82fbcf8b94 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:38.291549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488fe30-f461-4521-9d87-fba0868443f5 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:38.291846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488fe30-f461-4521-9d87-fba0868443f5 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:38.292188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488fe30-f461-4521-9d87-fba0868443f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:38.304087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:38.315349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-a488fe30-f461-4521-9d87-fba0868443f5 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:38.316941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a488fe30-f461-4521-9d87-fba0868443f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:38.349507 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:38.408346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 93/182] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:38.409284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488fe30-f461-4521-9d87-fba0868443f5 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:38.423644 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 90/183] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:11:38.426730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a189ef-2cc6-463d-a63d-8c82fbcf8b94 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:38.538959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a189ef-2cc6-463d-a63d-8c82fbcf8b94 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:38.540814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488fe30-f461-4521-9d87-fba0868443f5 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:38.579327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7873362-315c-4039-a02b-49d03753dfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:38.580264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7873362-315c-4039-a02b-49d03753dfa9 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:38.580780 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7873362-315c-4039-a02b-49d03753dfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:38.581223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12e93c-0e17-4e1f-99f9-5d4d0ccc70e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:38.581482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7873362-315c-4039-a02b-49d03753dfa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:38.581852 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12e93c-0e17-4e1f-99f9-5d4d0ccc70e5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:38.582161 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12e93c-0e17-4e1f-99f9-5d4d0ccc70e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:38.582443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12e93c-0e17-4e1f-99f9-5d4d0ccc70e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:38.586277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:38.593700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12e93c-0e17-4e1f-99f9-5d4d0ccc70e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:38.598429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2b12e93c-0e17-4e1f-99f9-5d4d0ccc70e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:38.598429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:38.598429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:38.598429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:38.598429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:38.598429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:38.598429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:38.598429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:38.598429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:38.598429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:38.598429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:38.598429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:38.598429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:38.598429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:38.598429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:38.598429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:38.599290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:38.599290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:38.599290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:38.599290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:38.599290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:38.599290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:38.599290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:38.599290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:38.599290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:38.599290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:38.599290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:38.599290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:38.599290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:38.599290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:38.599290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:38.599290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:38.600059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:38.600059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:38.600059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:38.600059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:38.600059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:38.600059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:38.600059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:38.600059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:38.600059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:38.600059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:38.600059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:38.600059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:38.600059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 91/184] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:11:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:38.600712 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12e93c-0e17-4e1f-99f9-5d4d0ccc70e5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:38.608963 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:38.660534 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7873362-315c-4039-a02b-49d03753dfa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:38.662019 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7873362-315c-4039-a02b-49d03753dfa9 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:38.714364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12e93c-0e17-4e1f-99f9-5d4d0ccc70e5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:38.750112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b30ce-556d-4648-81d6-dbac2db9f607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:38.751000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b30ce-556d-4648-81d6-dbac2db9f607 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:38.751275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b30ce-556d-4648-81d6-dbac2db9f607 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:38.751545 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b30ce-556d-4648-81d6-dbac2db9f607 None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:38.752658 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b30ce-556d-4648-81d6-dbac2db9f607 None admin] RBAC: Authorizing `identity:get_project(project_id=f39fd5a3969c4e89ad6198892166ec4d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:38.754134 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b30ce-556d-4648-81d6-dbac2db9f607 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:38.761134 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 92/185] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:38 2022] GET /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:38.761134 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b30ce-556d-4648-81d6-dbac2db9f607 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:38.768486 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 94/186] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:11:38.769390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7873362-315c-4039-a02b-49d03753dfa9 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:38.805335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:38.830953 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:38.859949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b30ce-556d-4648-81d6-dbac2db9f607 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:38.874041 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7873362-315c-4039-a02b-49d03753dfa9 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:38.895480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8aaa2e-ac01-4851-b202-197f040fdd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:38.896112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8aaa2e-ac01-4851-b202-197f040fdd0d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:38.896398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8aaa2e-ac01-4851-b202-197f040fdd0d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:38.896679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8aaa2e-ac01-4851-b202-197f040fdd0d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:38.906959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8aaa2e-ac01-4851-b202-197f040fdd0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:38.907862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da4c13-2d11-4905-9a2a-a3fb7e4ce338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:38.908743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da4c13-2d11-4905-9a2a-a3fb7e4ce338 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:38.909023 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da4c13-2d11-4905-9a2a-a3fb7e4ce338 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:38.909298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da4c13-2d11-4905-9a2a-a3fb7e4ce338 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:38.910428 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da4c13-2d11-4905-9a2a-a3fb7e4ce338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:38.911892 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da4c13-2d11-4905-9a2a-a3fb7e4ce338 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:38.912328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-8d8aaa2e-ac01-4851-b202-197f040fdd0d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:11:38.912328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:38.912328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:38.912328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:38.912328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:38.912328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:38.912328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:38.912328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:38.912328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:38.912328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:38.912328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:38.912328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:38.912328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:38.912328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:38.912328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:38.912328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:38.913336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:38.913336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:38.913336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:38.913336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:38.913336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:38.913336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:38.913336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:38.913336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:38.913336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:38.913336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:38.913336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:38.913336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:38.913336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:38.913336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:38.913336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:38.913336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:38.914171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:38.914171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:38.914171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:38.914171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:38.914171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:38.914171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:38.914171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:38.914171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:38.914171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:38.914171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:38.914171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:11:38.914171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:38.914171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 93/188] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:38.915185 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 95/188] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:38.915253 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8aaa2e-ac01-4851-b202-197f040fdd0d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:38.915318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da4c13-2d11-4905-9a2a-a3fb7e4ce338 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:39.014579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da4c13-2d11-4905-9a2a-a3fb7e4ce338 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:39.016702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8aaa2e-ac01-4851-b202-197f040fdd0d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:39.017640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:39.046258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:39.051330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2a282-7e69-46d5-a59b-b13322f96e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:39.051490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3a863-34e5-4021-a183-a4155fdeb589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:39.051935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3a863-34e5-4021-a183-a4155fdeb589 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:39.052030 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2a282-7e69-46d5-a59b-b13322f96e6c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:39.052214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2a282-7e69-46d5-a59b-b13322f96e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:39.052300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3a863-34e5-4021-a183-a4155fdeb589 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:39.052485 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2a282-7e69-46d5-a59b-b13322f96e6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:39.052582 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3a863-34e5-4021-a183-a4155fdeb589 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:39.053149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3a863-34e5-4021-a183-a4155fdeb589 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:39.053456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3a863-34e5-4021-a183-a4155fdeb589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:39.054859 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de3a863-34e5-4021-a183-a4155fdeb589 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:39.063439 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2a282-7e69-46d5-a59b-b13322f96e6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:39.063847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 94/189] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:39.064646 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3a863-34e5-4021-a183-a4155fdeb589 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:39.071678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-c7e2a282-7e69-46d5-a59b-b13322f96e6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:11:39.071678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:39.071678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:39.071678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:39.071678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:39.071678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:39.071678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:39.071678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:39.071678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:39.071678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:39.071678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:39.071678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:39.071678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:39.071678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:39.071678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:39.071678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:39.073689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:39.073689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:39.073689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:39.073689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:39.073689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:39.073689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:39.073689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:39.073689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:39.073689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:39.073689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:39.073689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:39.073689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:39.073689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:39.073689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:39.073689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:39.073689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:39.074492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:39.074492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:39.074492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:39.074492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:39.074492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:39.074492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:39.074492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:39.074492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:39.074492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:39.074492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:39.074492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:11:39.074492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:11:39.074492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 96/190] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:11:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:39.075135 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2a282-7e69-46d5-a59b-b13322f96e6c None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:39.169793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3a863-34e5-4021-a183-a4155fdeb589 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:39.181084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2a282-7e69-46d5-a59b-b13322f96e6c None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:39.205676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4660c-0b64-436a-b737-7c24e67d8751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:39.206308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4660c-0b64-436a-b737-7c24e67d8751 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:39.206591 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4660c-0b64-436a-b737-7c24e67d8751 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:39.206862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4660c-0b64-436a-b737-7c24e67d8751 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:39.207617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4660c-0b64-436a-b737-7c24e67d8751 None admin] RBAC: Adding query filter params (role.id=8de0c87242d7426ea25a510b578c02aa, scope.project.id=f39fd5a3969c4e89ad6198892166ec4d, user.id=307f76b84605446ea643922d0a93ba9f) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:39.207924 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4660c-0b64-436a-b737-7c24e67d8751 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:39.209343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4660c-0b64-436a-b737-7c24e67d8751 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:39.215041 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 95/191] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:11:39 2022] GET /identity/v3/role_assignments?user.id=307f76b84605446ea643922d0a93ba9f&scope.project.id=f39fd5a3969c4e89ad6198892166ec4d&role.id=8de0c87242d7426ea25a510b578c02aa => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:39.215891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4660c-0b64-436a-b737-7c24e67d8751 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:39.219161 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7895b-5409-4b8e-9bde-8c30097d9046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:39.219807 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7895b-5409-4b8e-9bde-8c30097d9046 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:39.220092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7895b-5409-4b8e-9bde-8c30097d9046 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:39.220368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7895b-5409-4b8e-9bde-8c30097d9046 None admin] PATH_INFO: `/v3/projects/9a26874f45bb48e589edbfb3370f51a6` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:39.221574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7895b-5409-4b8e-9bde-8c30097d9046 None admin] RBAC: Authorizing `identity:get_project(project_id=9a26874f45bb48e589edbfb3370f51a6)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:39.223134 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7895b-5409-4b8e-9bde-8c30097d9046 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:39.225039 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 97/192] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:39 2022] GET /identity/v3/projects/9a26874f45bb48e589edbfb3370f51a6 => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:39.225752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7895b-5409-4b8e-9bde-8c30097d9046 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:39.262463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:39.284702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:39.334961 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4660c-0b64-436a-b737-7c24e67d8751 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:39.346495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7895b-5409-4b8e-9bde-8c30097d9046 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:39.377473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a96b74-6321-41a3-8319-6108d06f4552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:39.378119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a96b74-6321-41a3-8319-6108d06f4552 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:39.378402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a96b74-6321-41a3-8319-6108d06f4552 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:39.378675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a96b74-6321-41a3-8319-6108d06f4552 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:39.379331 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a96b74-6321-41a3-8319-6108d06f4552 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:39.380797 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a96b74-6321-41a3-8319-6108d06f4552 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:39.389753 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a760c-cace-4fb6-ba52-ef213d3fd62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:39.389753 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a760c-cace-4fb6-ba52-ef213d3fd62d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:39.389998 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a760c-cace-4fb6-ba52-ef213d3fd62d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:39.390244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a760c-cace-4fb6-ba52-ef213d3fd62d None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:39.390845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a760c-cace-4fb6-ba52-ef213d3fd62d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:39.391157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a760c-cace-4fb6-ba52-ef213d3fd62d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:39.392802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a760c-cace-4fb6-ba52-ef213d3fd62d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:39.402600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 96/193] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 16:11:39 2022] POST /identity/v3/users => generated 297 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:11:39.403441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a96b74-6321-41a3-8319-6108d06f4552 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:39.410830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 98/194] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:39.411485 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a760c-cace-4fb6-ba52-ef213d3fd62d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:39.533935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a96b74-6321-41a3-8319-6108d06f4552 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:39.550426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:39.552242 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:39.561286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a760c-cace-4fb6-ba52-ef213d3fd62d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:39.576636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e073a-c3cc-4a48-bcbd-aa87b2445896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:39.577280 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e073a-c3cc-4a48-bcbd-aa87b2445896 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:39.578230 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e073a-c3cc-4a48-bcbd-aa87b2445896 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:39.578230 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e073a-c3cc-4a48-bcbd-aa87b2445896 None admin] PATH_INFO: `/v3/users/d29de5b6158442cca418338c0f61090a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:39.601352 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e073a-c3cc-4a48-bcbd-aa87b2445896 None admin] RBAC: Authorizing `identity:get_user(user_id=d29de5b6158442cca418338c0f61090a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:39.603186 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e073a-c3cc-4a48-bcbd-aa87b2445896 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:39.606536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 97/195] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:39 2022] GET /identity/v3/users/d29de5b6158442cca418338c0f61090a => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:39.608094 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e073a-c3cc-4a48-bcbd-aa87b2445896 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:39.616533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234066f-d6da-4d05-be7d-68086a7a35ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:39.617157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234066f-d6da-4d05-be7d-68086a7a35ae None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:39.617444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234066f-d6da-4d05-be7d-68086a7a35ae None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:39.617721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234066f-d6da-4d05-be7d-68086a7a35ae None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:39.618434 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234066f-d6da-4d05-be7d-68086a7a35ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:39.618744 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234066f-d6da-4d05-be7d-68086a7a35ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:39.620958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234066f-d6da-4d05-be7d-68086a7a35ae None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:39.636084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 99/196] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:11:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:39.636932 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234066f-d6da-4d05-be7d-68086a7a35ae None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:39.740405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e073a-c3cc-4a48-bcbd-aa87b2445896 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:39.771771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234066f-d6da-4d05-be7d-68086a7a35ae None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:39.783396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696af91-1fd4-4d76-871f-962986ab2477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:39.784016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696af91-1fd4-4d76-871f-962986ab2477 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:39.786305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696af91-1fd4-4d76-871f-962986ab2477 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:39.787104 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696af91-1fd4-4d76-871f-962986ab2477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:39.788542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696af91-1fd4-4d76-871f-962986ab2477 None admin] RBAC: Adding query filter params (role.id=8e4aa52bcd2a47389ee1c5de44fa28ca, scope.project.id=9a26874f45bb48e589edbfb3370f51a6, user.id=c194e717ca3a4063b26b04df33afe67b) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:39.789178 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696af91-1fd4-4d76-871f-962986ab2477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:39.791876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696af91-1fd4-4d76-871f-962986ab2477 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:39.799762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 98/197] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:11:39 2022] GET /identity/v3/role_assignments?user.id=c194e717ca3a4063b26b04df33afe67b&scope.project.id=9a26874f45bb48e589edbfb3370f51a6&role.id=8e4aa52bcd2a47389ee1c5de44fa28ca => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:39.801458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696af91-1fd4-4d76-871f-962986ab2477 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:39.815571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf95c03-7585-4846-b858-d29979bd8613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:39.816383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf95c03-7585-4846-b858-d29979bd8613 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:39.816775 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf95c03-7585-4846-b858-d29979bd8613 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:39.817121 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf95c03-7585-4846-b858-d29979bd8613 None admin] PATH_INFO: `/v3/users/5cc893e83f404c8595be758b5fbf60ff` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:39.818646 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf95c03-7585-4846-b858-d29979bd8613 None admin] RBAC: Authorizing `identity:get_user(user_id=5cc893e83f404c8595be758b5fbf60ff)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:39.819926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf95c03-7585-4846-b858-d29979bd8613 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:39.821923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 100/198] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:39 2022] GET /identity/v3/users/5cc893e83f404c8595be758b5fbf60ff => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:39.827133 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf95c03-7585-4846-b858-d29979bd8613 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:39.857939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:39.863578 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:39.950378 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696af91-1fd4-4d76-871f-962986ab2477 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:39.956917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf95c03-7585-4846-b858-d29979bd8613 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:39.996987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0864de-61e5-4701-9bd8-38c087411fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:39.998185 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0864de-61e5-4701-9bd8-38c087411fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:39.998684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0864de-61e5-4701-9bd8-38c087411fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:39.999156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0864de-61e5-4701-9bd8-38c087411fb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:40.000112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9736a0-a493-4ee6-89ea-cb755a76b6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:40.000907 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9736a0-a493-4ee6-89ea-cb755a76b6ad None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:40.001196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9736a0-a493-4ee6-89ea-cb755a76b6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:40.001472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9736a0-a493-4ee6-89ea-cb755a76b6ad None admin] PATH_INFO: `/v3/users/d29de5b6158442cca418338c0f61090a` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:40.002672 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9736a0-a493-4ee6-89ea-cb755a76b6ad None admin] RBAC: Authorizing `identity:get_user(user_id=d29de5b6158442cca418338c0f61090a)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:40.004179 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9736a0-a493-4ee6-89ea-cb755a76b6ad None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:40.006191 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 101/199] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:39 2022] GET /identity/v3/users/d29de5b6158442cca418338c0f61090a => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:40.007085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9736a0-a493-4ee6-89ea-cb755a76b6ad None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:40.095016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0864de-61e5-4701-9bd8-38c087411fb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:40.097349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0864de-61e5-4701-9bd8-38c087411fb3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:40.117868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:40.129252 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9736a0-a493-4ee6-89ea-cb755a76b6ad None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:40.144290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:40.171985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56e064-f1bb-4f33-b464-b18e462bfc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:40.172839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56e064-f1bb-4f33-b464-b18e462bfc5e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:40.173264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56e064-f1bb-4f33-b464-b18e462bfc5e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:40.179152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56e064-f1bb-4f33-b464-b18e462bfc5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:40.233124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 99/200] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:11:40.233958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0864de-61e5-4701-9bd8-38c087411fb3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:40.287676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56e064-f1bb-4f33-b464-b18e462bfc5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:40.289333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56e064-f1bb-4f33-b464-b18e462bfc5e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:40.391635 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0864de-61e5-4701-9bd8-38c087411fb3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:40.409088 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:40.424791 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 102/201] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:11:40.430117 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56e064-f1bb-4f33-b464-b18e462bfc5e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:40.444072 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f10440-1116-4d6f-a876-39a791dec62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:40.445046 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f10440-1116-4d6f-a876-39a791dec62a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:40.445523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f10440-1116-4d6f-a876-39a791dec62a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:40.446034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f10440-1116-4d6f-a876-39a791dec62a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:40.452531 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:40.553926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f10440-1116-4d6f-a876-39a791dec62a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:40.555643 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f10440-1116-4d6f-a876-39a791dec62a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:40.560561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56e064-f1bb-4f33-b464-b18e462bfc5e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:40.607848 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79ee6f-035c-43d7-b107-60b209cf764d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:40.608800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79ee6f-035c-43d7-b107-60b209cf764d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:40.609238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79ee6f-035c-43d7-b107-60b209cf764d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:40.609643 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79ee6f-035c-43d7-b107-60b209cf764d None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:40.611248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79ee6f-035c-43d7-b107-60b209cf764d None admin] RBAC: Authorizing `identity:get_project(project_id=f02e08c335f848b3969fbf9251eecd90)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:40.614031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79ee6f-035c-43d7-b107-60b209cf764d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:40.616776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 103/202] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:40 2022] GET /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:40.618181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79ee6f-035c-43d7-b107-60b209cf764d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:40.693782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:40.695121 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 100/203] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:11:40.696190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f10440-1116-4d6f-a876-39a791dec62a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:40.743163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:40.754581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79ee6f-035c-43d7-b107-60b209cf764d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:40.803429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595f7ee-534a-466a-93b5-448b7a215929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:40.804066 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595f7ee-534a-466a-93b5-448b7a215929 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:40.804346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595f7ee-534a-466a-93b5-448b7a215929 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:40.804618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595f7ee-534a-466a-93b5-448b7a215929 None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:40.806018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595f7ee-534a-466a-93b5-448b7a215929 None admin] RBAC: Authorizing `identity:get_project(project_id=f39fd5a3969c4e89ad6198892166ec4d)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:40.807667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595f7ee-534a-466a-93b5-448b7a215929 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:40.814124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 104/204] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:40 2022] GET /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:40.814124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595f7ee-534a-466a-93b5-448b7a215929 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:40.840195 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f10440-1116-4d6f-a876-39a791dec62a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:40.898940 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac68bfc-b37e-4b5a-bf10-aaa30c4266c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:40.900324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac68bfc-b37e-4b5a-bf10-aaa30c4266c9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:40.901811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac68bfc-b37e-4b5a-bf10-aaa30c4266c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:40.902493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac68bfc-b37e-4b5a-bf10-aaa30c4266c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:40.903596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac68bfc-b37e-4b5a-bf10-aaa30c4266c9 None admin] RBAC: Adding query filter params (role.id=8de0c87242d7426ea25a510b578c02aa, scope.project.id=f02e08c335f848b3969fbf9251eecd90, user.id=d29de5b6158442cca418338c0f61090a) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:40.904107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac68bfc-b37e-4b5a-bf10-aaa30c4266c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:40.906664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac68bfc-b37e-4b5a-bf10-aaa30c4266c9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:40.916986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 101/205] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:11:40 2022] GET /identity/v3/role_assignments?user.id=d29de5b6158442cca418338c0f61090a&scope.project.id=f02e08c335f848b3969fbf9251eecd90&role.id=8de0c87242d7426ea25a510b578c02aa => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:40.918677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac68bfc-b37e-4b5a-bf10-aaa30c4266c9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:40.981320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595f7ee-534a-466a-93b5-448b7a215929 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:41.011124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:41.029380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e2e7e-f314-4ff9-9d83-28b3d8f611f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:41.030046 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e2e7e-f314-4ff9-9d83-28b3d8f611f6 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:41.030350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e2e7e-f314-4ff9-9d83-28b3d8f611f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:41.030624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e2e7e-f314-4ff9-9d83-28b3d8f611f6 None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:41.032198 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e2e7e-f314-4ff9-9d83-28b3d8f611f6 None admin] RBAC: Authorizing `identity:get_project(project_id=f02e08c335f848b3969fbf9251eecd90)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:41.033709 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e2e7e-f314-4ff9-9d83-28b3d8f611f6 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:41.035416 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 105/206] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:40 2022] GET /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:41.041943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e2e7e-f314-4ff9-9d83-28b3d8f611f6 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:41.070388 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac68bfc-b37e-4b5a-bf10-aaa30c4266c9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:41.092863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:41.114607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806f9ec-9a1f-4a81-a760-999fa00542f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:41.115612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806f9ec-9a1f-4a81-a760-999fa00542f5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:41.116143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806f9ec-9a1f-4a81-a760-999fa00542f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:41.116648 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806f9ec-9a1f-4a81-a760-999fa00542f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:41.117765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806f9ec-9a1f-4a81-a760-999fa00542f5 None admin] RBAC: Adding query filter params (role.id=bbb7d9816b1d4ba394a847d12fbe7abf, scope.project.id=f39fd5a3969c4e89ad6198892166ec4d, user.id=5cc893e83f404c8595be758b5fbf60ff) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:41.118320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806f9ec-9a1f-4a81-a760-999fa00542f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:41.120731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806f9ec-9a1f-4a81-a760-999fa00542f5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:41.127861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 102/207] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:11:40 2022] GET /identity/v3/role_assignments?user.id=5cc893e83f404c8595be758b5fbf60ff&scope.project.id=f39fd5a3969c4e89ad6198892166ec4d&role.id=bbb7d9816b1d4ba394a847d12fbe7abf => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:41.185587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e2e7e-f314-4ff9-9d83-28b3d8f611f6 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:41.224417 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38e893-6f7c-4459-bd13-d1b42fc1b213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:41.225049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38e893-6f7c-4459-bd13-d1b42fc1b213 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:41.225326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38e893-6f7c-4459-bd13-d1b42fc1b213 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:41.225602 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38e893-6f7c-4459-bd13-d1b42fc1b213 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:41.226376 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38e893-6f7c-4459-bd13-d1b42fc1b213 None admin] RBAC: Adding query filter params (role.id=41d658f3417e4e48b117d57120991ad8, scope.project.id=f02e08c335f848b3969fbf9251eecd90, user.id=d29de5b6158442cca418338c0f61090a) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:41.226687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38e893-6f7c-4459-bd13-d1b42fc1b213 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:41.228166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38e893-6f7c-4459-bd13-d1b42fc1b213 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:41.235894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 106/208] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:11:41 2022] GET /identity/v3/role_assignments?user.id=d29de5b6158442cca418338c0f61090a&scope.project.id=f02e08c335f848b3969fbf9251eecd90&role.id=41d658f3417e4e48b117d57120991ad8 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:41.650349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fbe27-284a-4ea0-aeda-02e052a71c74 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:41.651957 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fbe27-284a-4ea0-aeda-02e052a71c74 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:41.652584 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fbe27-284a-4ea0-aeda-02e052a71c74 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:41.654406 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 103/209] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:41.660484 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44033b25-d78d-4e43-8b64-6b9e6926c46b None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:41.661353 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44033b25-d78d-4e43-8b64-6b9e6926c46b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:41.661827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44033b25-d78d-4e43-8b64-6b9e6926c46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:41.681373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-44033b25-d78d-4e43-8b64-6b9e6926c46b None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:41.683529 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-44033b25-d78d-4e43-8b64-6b9e6926c46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:41.753513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:41.772412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 107/210] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:41.965791 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d40051-1afb-4aa1-81e7-1cf241f24c65 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:41.966100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d40051-1afb-4aa1-81e7-1cf241f24c65 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:41.966423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d40051-1afb-4aa1-81e7-1cf241f24c65 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:41.967777 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 104/211] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:11:41.972977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee381a69-2818-4fc5-bedf-8ddf71cc214d None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:41.973270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee381a69-2818-4fc5-bedf-8ddf71cc214d None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:41.973545 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee381a69-2818-4fc5-bedf-8ddf71cc214d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:41.992685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-ee381a69-2818-4fc5-bedf-8ddf71cc214d None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:41.993885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ee381a69-2818-4fc5-bedf-8ddf71cc214d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:42.058674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d40051-1afb-4aa1-81e7-1cf241f24c65 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:42.065276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 108/212] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:42.169755 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d40051-1afb-4aa1-81e7-1cf241f24c65 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:42.205521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a80346-5370-4a49-aacf-d216b9e18c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:42.206220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a80346-5370-4a49-aacf-d216b9e18c81 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:42.206508 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a80346-5370-4a49-aacf-d216b9e18c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:42.206783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a80346-5370-4a49-aacf-d216b9e18c81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:42.217712 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a80346-5370-4a49-aacf-d216b9e18c81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:42.222969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-45a80346-5370-4a49-aacf-d216b9e18c81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:42.222969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:42.222969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:42.222969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:42.222969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:42.222969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:42.222969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:42.222969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:42.222969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:42.222969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:42.222969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:42.222969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:42.222969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:42.222969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:42.222969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:42.222969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:42.224579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:42.224579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:42.224579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:42.224579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:42.224579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:42.224579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:42.224579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:42.224579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:42.224579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:42.224579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:42.224579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:42.224579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:42.224579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:42.224579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:42.224579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:42.224579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:42.226085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:42.226085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:42.226085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:42.226085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:42.226085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:42.226085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:42.226085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:42.226085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:42.226085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:42.226085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:42.226085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:42.226085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:42.229513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 105/213] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:11:42.231044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee381a69-2818-4fc5-bedf-8ddf71cc214d None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:42.338379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee381a69-2818-4fc5-bedf-8ddf71cc214d None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:42.344436 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a80346-5370-4a49-aacf-d216b9e18c81 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:42.364516 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:42.378208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:42.379121 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed52b23-6f00-4add-a698-197fd861505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:42.379741 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed52b23-6f00-4add-a698-197fd861505b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:42.380028 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed52b23-6f00-4add-a698-197fd861505b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:42.380308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed52b23-6f00-4add-a698-197fd861505b None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:42.381041 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed52b23-6f00-4add-a698-197fd861505b None admin] RBAC: Adding query filter params (name=member) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:42.381296 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed52b23-6f00-4add-a698-197fd861505b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:42.382765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed52b23-6f00-4add-a698-197fd861505b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:42.394548 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 109/214] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:42.399861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed52b23-6f00-4add-a698-197fd861505b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:42.471762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a80346-5370-4a49-aacf-d216b9e18c81 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:42.516758 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022f068-19a3-4403-8018-d0cda39cd78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:42.517796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022f068-19a3-4403-8018-d0cda39cd78b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:42.518216 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022f068-19a3-4403-8018-d0cda39cd78b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:42.518917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022f068-19a3-4403-8018-d0cda39cd78b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:42.520243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022f068-19a3-4403-8018-d0cda39cd78b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:42.522009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022f068-19a3-4403-8018-d0cda39cd78b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:42.523958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 106/215] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:42.529590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022f068-19a3-4403-8018-d0cda39cd78b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:42.540312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed52b23-6f00-4add-a698-197fd861505b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:42.578082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac0b12-0696-4321-ac20-8dc51fd80741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:42.578317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac0b12-0696-4321-ac20-8dc51fd80741 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:42.578535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac0b12-0696-4321-ac20-8dc51fd80741 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:42.578721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac0b12-0696-4321-ac20-8dc51fd80741 None admin] PATH_INFO: `/v3/users/7cd66c02dd8e4418b837b553b90e5b8b` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:42.593002 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac0b12-0696-4321-ac20-8dc51fd80741 None admin] RBAC: Authorizing `identity:get_user(user_id=7cd66c02dd8e4418b837b553b90e5b8b)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:42.594471 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac0b12-0696-4321-ac20-8dc51fd80741 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:42.596393 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 110/216] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:42 2022] GET /identity/v3/users/7cd66c02dd8e4418b837b553b90e5b8b => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:42.603168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac0b12-0696-4321-ac20-8dc51fd80741 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:42.653696 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:42.655234 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:42.665989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022f068-19a3-4403-8018-d0cda39cd78b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:42.703957 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b24cff-750d-4334-94bd-40d5b0313c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:42.704602 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b24cff-750d-4334-94bd-40d5b0313c3a None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:42.704887 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b24cff-750d-4334-94bd-40d5b0313c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:42.705162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b24cff-750d-4334-94bd-40d5b0313c3a None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:42.705817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b24cff-750d-4334-94bd-40d5b0313c3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:42.707487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b24cff-750d-4334-94bd-40d5b0313c3a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:42.734257 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac0b12-0696-4321-ac20-8dc51fd80741 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:42.738226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 107/217] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 16:11:42 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:11:42.789894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b5934-340d-48ea-bc57-0673a089aeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:42.791975 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b5934-340d-48ea-bc57-0673a089aeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:42.792735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b5934-340d-48ea-bc57-0673a089aeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:42.793389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b5934-340d-48ea-bc57-0673a089aeb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:42.887119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b5934-340d-48ea-bc57-0673a089aeb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:42.888973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b5934-340d-48ea-bc57-0673a089aeb2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:42.940961 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:43.005348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 111/218] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:11:43.011756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b24cff-750d-4334-94bd-40d5b0313c3a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:43.125719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b24cff-750d-4334-94bd-40d5b0313c3a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:43.161388 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc669d08-ab4d-4acc-b85a-62cc59246ec5 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:43.161388 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc669d08-ab4d-4acc-b85a-62cc59246ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:43.161626 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc669d08-ab4d-4acc-b85a-62cc59246ec5 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:43.163978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 112/219] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:43.169385 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12fc02-278d-45a0-b87c-0a4603f0744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:43.169636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa49584-911f-43cf-9302-fb8bcc18f4a1 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:43.169901 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa49584-911f-43cf-9302-fb8bcc18f4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:43.170125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12fc02-278d-45a0-b87c-0a4603f0744f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:43.170239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa49584-911f-43cf-9302-fb8bcc18f4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:43.170414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12fc02-278d-45a0-b87c-0a4603f0744f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:43.170692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12fc02-278d-45a0-b87c-0a4603f0744f None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:43.171910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12fc02-278d-45a0-b87c-0a4603f0744f None admin] RBAC: Authorizing `identity:get_project(project_id=f02e08c335f848b3969fbf9251eecd90)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:43.173345 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12fc02-278d-45a0-b87c-0a4603f0744f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:43.175222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 108/220] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:43 2022] GET /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:43.180799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12fc02-278d-45a0-b87c-0a4603f0744f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:43.199627 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-4aa49584-911f-43cf-9302-fb8bcc18f4a1 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:43.200819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4aa49584-911f-43cf-9302-fb8bcc18f4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:43.204412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:43.293526 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 113/221] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:43.326535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12fc02-278d-45a0-b87c-0a4603f0744f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:43.389223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d82e75-d5a0-4c92-b8c1-a3eb04e5f846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:43.390626 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d82e75-d5a0-4c92-b8c1-a3eb04e5f846 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:43.391241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d82e75-d5a0-4c92-b8c1-a3eb04e5f846 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:43.391969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d82e75-d5a0-4c92-b8c1-a3eb04e5f846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:43.393099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d82e75-d5a0-4c92-b8c1-a3eb04e5f846 None admin] RBAC: Adding query filter params (role.id=8e4aa52bcd2a47389ee1c5de44fa28ca, scope.project.id=f02e08c335f848b3969fbf9251eecd90, user.id=7cd66c02dd8e4418b837b553b90e5b8b) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:43.393594 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d82e75-d5a0-4c92-b8c1-a3eb04e5f846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:43.395402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d82e75-d5a0-4c92-b8c1-a3eb04e5f846 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:43.408864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 109/222] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:11:43 2022] GET /identity/v3/role_assignments?user.id=7cd66c02dd8e4418b837b553b90e5b8b&scope.project.id=f02e08c335f848b3969fbf9251eecd90&role.id=8e4aa52bcd2a47389ee1c5de44fa28ca => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:43.605013 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa49584-911f-43cf-9302-fb8bcc18f4a1 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:43.700906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceac45-b0f7-4cc1-98f8-47ce3bbe266c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:43.701764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceac45-b0f7-4cc1-98f8-47ce3bbe266c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:43.702046 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceac45-b0f7-4cc1-98f8-47ce3bbe266c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:43.703654 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 110/223] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:43.711894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c16ae9-5e4f-4743-954b-cbc15b7d4f1f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:43.712207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c16ae9-5e4f-4743-954b-cbc15b7d4f1f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:43.712447 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c16ae9-5e4f-4743-954b-cbc15b7d4f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:43.714582 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:43.752936 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-40c16ae9-5e4f-4743-954b-cbc15b7d4f1f None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:43.754555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-40c16ae9-5e4f-4743-954b-cbc15b7d4f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:43.797540 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa49584-911f-43cf-9302-fb8bcc18f4a1 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:43.911260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf40a3-821a-4de3-b1cb-bced8e64fdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:43.912019 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf40a3-821a-4de3-b1cb-bced8e64fdeb None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:43.912455 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf40a3-821a-4de3-b1cb-bced8e64fdeb None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:43.913582 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf40a3-821a-4de3-b1cb-bced8e64fdeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:43.948919 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf40a3-821a-4de3-b1cb-bced8e64fdeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:43.955745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-48bf40a3-821a-4de3-b1cb-bced8e64fdeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:43.955745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:43.955745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:43.955745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:43.955745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:43.955745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:43.955745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:43.955745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:43.955745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:43.955745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:43.955745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:43.955745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:43.955745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:43.955745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:43.955745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:43.955745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:43.956660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:43.956660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:43.956660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:43.956660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:43.956660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:43.956660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:43.956660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:43.956660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:43.956660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:43.956660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:43.956660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:43.956660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:43.956660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:43.956660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:43.956660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:43.956660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:43.957426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:43.957426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:43.957426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:43.957426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:43.957426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:43.957426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:43.957426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:43.957426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:43.957426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:43.957426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:43.957426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:43.957426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:11:43.957426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 114/224] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:11:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:43.970099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf40a3-821a-4de3-b1cb-bced8e64fdeb None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:44.052801 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 111/225] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:44.238637 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf40a3-821a-4de3-b1cb-bced8e64fdeb None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:44.292058 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:44.305992 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cf136-8998-49f7-b1e0-bdfe6f8837d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:44.307854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cf136-8998-49f7-b1e0-bdfe6f8837d5 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:44.308144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cf136-8998-49f7-b1e0-bdfe6f8837d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:44.314115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cf136-8998-49f7-b1e0-bdfe6f8837d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:44.314115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cf136-8998-49f7-b1e0-bdfe6f8837d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:44.314115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cf136-8998-49f7-b1e0-bdfe6f8837d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:44.314115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cf136-8998-49f7-b1e0-bdfe6f8837d5 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:44.321808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 115/226] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:44.328222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c16ae9-5e4f-4743-954b-cbc15b7d4f1f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:44.357103 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:44.467369 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cf136-8998-49f7-b1e0-bdfe6f8837d5 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:44.591977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cf136-8998-49f7-b1e0-bdfe6f8837d5 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:44.604625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c16ae9-5e4f-4743-954b-cbc15b7d4f1f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:44.630340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304be22f-1244-498f-bfdd-f2f21ca67c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:44.631147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304be22f-1244-498f-bfdd-f2f21ca67c19 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:44.631439 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304be22f-1244-498f-bfdd-f2f21ca67c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:44.631714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304be22f-1244-498f-bfdd-f2f21ca67c19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:44.642703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304be22f-1244-498f-bfdd-f2f21ca67c19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:44.647918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-304be22f-1244-498f-bfdd-f2f21ca67c19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:11:44.647918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:44.647918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:44.647918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:44.647918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:44.647918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:44.647918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:44.647918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:44.647918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:44.647918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:44.647918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:44.647918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:44.647918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:44.647918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:44.647918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:44.647918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:44.648786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:44.648786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:44.648786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:44.648786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:44.648786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:44.648786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:44.648786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:44.648786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:44.648786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:44.648786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:44.648786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:44.648786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:44.648786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:44.648786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:44.648786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:44.648786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:44.649568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:44.649568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:44.649568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:44.649568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:44.649568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:44.649568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:44.649568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:44.649568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:44.649568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:44.649568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:44.649568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:11:44.649568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:11:44.649568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 116/227] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:11:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:44.656157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304be22f-1244-498f-bfdd-f2f21ca67c19 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:44.693516 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0159c-4a7b-4904-8394-010b36ecf415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:44.694643 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0159c-4a7b-4904-8394-010b36ecf415 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:44.695039 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0159c-4a7b-4904-8394-010b36ecf415 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:44.695421 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0159c-4a7b-4904-8394-010b36ecf415 None admin] PATH_INFO: `/v3/users/d29de5b6158442cca418338c0f61090a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:44.700866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0159c-4a7b-4904-8394-010b36ecf415 None admin] RBAC: Authorizing `identity:get_user(user_id=d29de5b6158442cca418338c0f61090a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:44.703239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0159c-4a7b-4904-8394-010b36ecf415 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:44.706043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 112/228] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:44 2022] GET /identity/v3/users/d29de5b6158442cca418338c0f61090a => generated 283 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:44.718036 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0159c-4a7b-4904-8394-010b36ecf415 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:44.720164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:44.776667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304be22f-1244-498f-bfdd-f2f21ca67c19 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:44.822427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267a0b2-5f05-42ca-b71c-b3a8bff1f5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:44.823062 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267a0b2-5f05-42ca-b71c-b3a8bff1f5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:44.823338 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267a0b2-5f05-42ca-b71c-b3a8bff1f5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:44.823612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267a0b2-5f05-42ca-b71c-b3a8bff1f5b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:44.824300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267a0b2-5f05-42ca-b71c-b3a8bff1f5b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:44.824607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267a0b2-5f05-42ca-b71c-b3a8bff1f5b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:44.826005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267a0b2-5f05-42ca-b71c-b3a8bff1f5b7 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:44.836207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 117/229] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:11:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:44.842769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267a0b2-5f05-42ca-b71c-b3a8bff1f5b7 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:44.931355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:44.958448 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267a0b2-5f05-42ca-b71c-b3a8bff1f5b7 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:44.975206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:44.982796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0159c-4a7b-4904-8394-010b36ecf415 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:44.999813 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784ab1b-0141-471e-aa25-20338fcd34d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:45.000904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784ab1b-0141-471e-aa25-20338fcd34d2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:45.001197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784ab1b-0141-471e-aa25-20338fcd34d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:45.001474 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784ab1b-0141-471e-aa25-20338fcd34d2 None admin] PATH_INFO: `/v3/users/d29de5b6158442cca418338c0f61090a` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:45.002654 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784ab1b-0141-471e-aa25-20338fcd34d2 None admin] RBAC: Authorizing `identity:get_user(user_id=d29de5b6158442cca418338c0f61090a)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:45.004167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784ab1b-0141-471e-aa25-20338fcd34d2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:45.006082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 118/230] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:44 2022] GET /identity/v3/users/d29de5b6158442cca418338c0f61090a => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:45.011915 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784ab1b-0141-471e-aa25-20338fcd34d2 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:45.079812 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bbe30-612b-40b0-ad51-bfbdbaf88c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:45.080697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bbe30-612b-40b0-ad51-bfbdbaf88c90 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:45.081085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bbe30-612b-40b0-ad51-bfbdbaf88c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:45.081465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bbe30-612b-40b0-ad51-bfbdbaf88c90 None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:45.087102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bbe30-612b-40b0-ad51-bfbdbaf88c90 None admin] RBAC: Authorizing `identity:get_project(project_id=f02e08c335f848b3969fbf9251eecd90)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:45.089355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bbe30-612b-40b0-ad51-bfbdbaf88c90 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:45.092185 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 113/231] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:44 2022] GET /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90 => generated 302 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:45.098248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bbe30-612b-40b0-ad51-bfbdbaf88c90 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:45.125977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784ab1b-0141-471e-aa25-20338fcd34d2 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:45.166886 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cbc07-e1d8-446f-975e-076c6ae398a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:45.167879 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cbc07-e1d8-446f-975e-076c6ae398a6 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:45.168148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cbc07-e1d8-446f-975e-076c6ae398a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:45.168433 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9cbc07-e1d8-446f-975e-076c6ae398a6 None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:45.169793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cbc07-e1d8-446f-975e-076c6ae398a6 None admin] RBAC: Authorizing `identity:get_project(project_id=f02e08c335f848b3969fbf9251eecd90)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:45.172234 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9cbc07-e1d8-446f-975e-076c6ae398a6 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:45.175735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 119/232] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:45 2022] GET /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:45.183071 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cbc07-e1d8-446f-975e-076c6ae398a6 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:45.242057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:45.311667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9cbc07-e1d8-446f-975e-076c6ae398a6 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:45.344960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bbe30-612b-40b0-ad51-bfbdbaf88c90 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:45.370022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6378a-0604-4dfd-a93a-a04ea4bad3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:45.370721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6378a-0604-4dfd-a93a-a04ea4bad3b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:45.371008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6378a-0604-4dfd-a93a-a04ea4bad3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:45.371290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6378a-0604-4dfd-a93a-a04ea4bad3b3 None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90/users/d29de5b6158442cca418338c0f61090a/roles/41d658f3417e4e48b117d57120991ad8` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:45.374373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6378a-0604-4dfd-a93a-a04ea4bad3b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f02e08c335f848b3969fbf9251eecd90, user_id=d29de5b6158442cca418338c0f61090a, role_id=41d658f3417e4e48b117d57120991ad8)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:45.375840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6378a-0604-4dfd-a93a-a04ea4bad3b3 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:45.392673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 120/233] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:11:45 2022] PUT /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90/users/d29de5b6158442cca418338c0f61090a/roles/41d658f3417e4e48b117d57120991ad8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:11:45.440212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a203b-8a45-4244-bb9f-038417d013ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:45.440895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a203b-8a45-4244-bb9f-038417d013ca None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:45.441171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a203b-8a45-4244-bb9f-038417d013ca None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:45.441440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a203b-8a45-4244-bb9f-038417d013ca None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90/users/d29de5b6158442cca418338c0f61090a/roles/8de0c87242d7426ea25a510b578c02aa` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:45.445579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a203b-8a45-4244-bb9f-038417d013ca None admin] RBAC: Authorizing `identity:create_grant(project_id=f02e08c335f848b3969fbf9251eecd90, user_id=d29de5b6158442cca418338c0f61090a, role_id=8de0c87242d7426ea25a510b578c02aa)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:45.447115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a203b-8a45-4244-bb9f-038417d013ca None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:45.476811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 114/234] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:11:45 2022] PUT /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90/users/d29de5b6158442cca418338c0f61090a/roles/8de0c87242d7426ea25a510b578c02aa => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:11:45.851818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976dfba9-ce02-4fa5-b9d1-2884d292f9bf None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:45.852621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976dfba9-ce02-4fa5-b9d1-2884d292f9bf None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:45.852621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976dfba9-ce02-4fa5-b9d1-2884d292f9bf None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:45.855211 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c31d2-cec5-4d5b-9c38-6cec0288d6b0 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:45.855777 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c31d2-cec5-4d5b-9c38-6cec0288d6b0 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:45.855777 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c31d2-cec5-4d5b-9c38-6cec0288d6b0 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:45.857387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 115/235] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:45.857591 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 121/236] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:45.863279 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c2714-e4c5-4d44-8b2b-9aa2047ad6d2 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:45.863566 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c2714-e4c5-4d44-8b2b-9aa2047ad6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:45.863848 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c2714-e4c5-4d44-8b2b-9aa2047ad6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:45.867665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38117912-f588-4f5f-a1f5-23a35b02df58 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:45.867958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38117912-f588-4f5f-a1f5-23a35b02df58 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:45.868235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38117912-f588-4f5f-a1f5-23a35b02df58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:45.889113 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:45.901767 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-38117912-f588-4f5f-a1f5-23a35b02df58 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:45.903247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-38117912-f588-4f5f-a1f5-23a35b02df58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:45.908700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-d91c2714-e4c5-4d44-8b2b-9aa2047ad6d2 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:45.910529 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d91c2714-e4c5-4d44-8b2b-9aa2047ad6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:45.984539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 116/237] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:46.067102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 122/238] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:46.297873 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38117912-f588-4f5f-a1f5-23a35b02df58 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:46.408668 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38117912-f588-4f5f-a1f5-23a35b02df58 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:46.455478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08beb211-aa13-4bc5-8a97-4e568c87cf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:46.456124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08beb211-aa13-4bc5-8a97-4e568c87cf9d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:46.456412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08beb211-aa13-4bc5-8a97-4e568c87cf9d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:46.456686 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08beb211-aa13-4bc5-8a97-4e568c87cf9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:46.457816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08beb211-aa13-4bc5-8a97-4e568c87cf9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:46.458459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c2714-e4c5-4d44-8b2b-9aa2047ad6d2 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:46.459313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08beb211-aa13-4bc5-8a97-4e568c87cf9d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:46.461410 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 117/239] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:46.467489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08beb211-aa13-4bc5-8a97-4e568c87cf9d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:46.474354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:46.532852 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:46.609239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c2714-e4c5-4d44-8b2b-9aa2047ad6d2 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:46.616720 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08beb211-aa13-4bc5-8a97-4e568c87cf9d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:46.647785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d671e-e5aa-4cd6-b5c8-9fb862d8c833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:46.648621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d671e-e5aa-4cd6-b5c8-9fb862d8c833 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:46.648946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d671e-e5aa-4cd6-b5c8-9fb862d8c833 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:46.649322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d671e-e5aa-4cd6-b5c8-9fb862d8c833 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:46.659710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2af2df-a44e-429e-b0b8-5f5fc157ab33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:46.660528 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2af2df-a44e-429e-b0b8-5f5fc157ab33 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:46.660976 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2af2df-a44e-429e-b0b8-5f5fc157ab33 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:46.661400 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2af2df-a44e-429e-b0b8-5f5fc157ab33 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:46.661878 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d671e-e5aa-4cd6-b5c8-9fb862d8c833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:46.662403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2af2df-a44e-429e-b0b8-5f5fc157ab33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:46.663981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2af2df-a44e-429e-b0b8-5f5fc157ab33 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:46.667896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-a26d671e-e5aa-4cd6-b5c8-9fb862d8c833 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:11:46.667896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:46.667896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:46.667896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:46.667896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:46.667896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:46.667896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:46.667896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:46.667896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:46.667896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:46.667896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:46.667896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:46.667896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:46.667896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:46.667896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:46.667896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:46.668824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:46.668824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:46.668824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:46.668824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:46.668824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:46.668824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:46.668824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:46.668824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:46.668824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:46.668824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:46.668824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:46.668824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:46.668824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:46.668824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:46.668824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:46.668824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:46.669611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:46.669611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:46.669611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:46.669611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:46.669611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:46.669611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:46.669611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:46.669611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:46.669611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:46.669611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:46.669611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:11:46.669611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:11:46.669611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 123/240] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:46.670653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19f4c2-68ff-4487-8bfd-ffa998ecbd55 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:46.671136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19f4c2-68ff-4487-8bfd-ffa998ecbd55 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:46.671510 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19f4c2-68ff-4487-8bfd-ffa998ecbd55 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:46.672860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 124/241] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:46.677884 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19f4c2-68ff-4487-8bfd-ffa998ecbd55 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:46.692471 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 118/242] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 16:11:46 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:11:46.700097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd812b-71ec-4c82-9bf3-a8e37aa7d129 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:46.700747 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd812b-71ec-4c82-9bf3-a8e37aa7d129 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:46.701239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd812b-71ec-4c82-9bf3-a8e37aa7d129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:46.737426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c7dd812b-71ec-4c82-9bf3-a8e37aa7d129 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:46.739006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c7dd812b-71ec-4c82-9bf3-a8e37aa7d129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:46.799281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:46.801476 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19f4c2-68ff-4487-8bfd-ffa998ecbd55 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:46.841920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff32a4-3946-4ddb-a39a-61cc622b8c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:46.848631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff32a4-3946-4ddb-a39a-61cc622b8c7f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:46.848631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff32a4-3946-4ddb-a39a-61cc622b8c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:46.848631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff32a4-3946-4ddb-a39a-61cc622b8c7f None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:46.848631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff32a4-3946-4ddb-a39a-61cc622b8c7f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:46.848631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff32a4-3946-4ddb-a39a-61cc622b8c7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:46.848631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff32a4-3946-4ddb-a39a-61cc622b8c7f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:46.851885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:46.860115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 125/243] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:46.865838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff32a4-3946-4ddb-a39a-61cc622b8c7f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:46.885048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 119/244] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:46.994020 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff32a4-3946-4ddb-a39a-61cc622b8c7f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:47.030192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7252c7-d1b0-482c-afc7-b0cd77756fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:47.031188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7252c7-d1b0-482c-afc7-b0cd77756fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:47.031670 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7252c7-d1b0-482c-afc7-b0cd77756fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:47.032160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7252c7-d1b0-482c-afc7-b0cd77756fd5 None admin] PATH_INFO: `/v3/users/a4b88dc82a664dff83567932a1fcf10e` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:47.047252 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7252c7-d1b0-482c-afc7-b0cd77756fd5 None admin] RBAC: Authorizing `identity:get_user(user_id=a4b88dc82a664dff83567932a1fcf10e)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:47.048977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7252c7-d1b0-482c-afc7-b0cd77756fd5 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:47.050890 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 126/245] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:46 2022] GET /identity/v3/users/a4b88dc82a664dff83567932a1fcf10e => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:47.056637 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd812b-71ec-4c82-9bf3-a8e37aa7d129 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:47.174529 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd812b-71ec-4c82-9bf3-a8e37aa7d129 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:47.220891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0fceb-4a3e-4ffc-bc48-e44ab2c3e6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:47.221526 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0fceb-4a3e-4ffc-bc48-e44ab2c3e6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:47.221807 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0fceb-4a3e-4ffc-bc48-e44ab2c3e6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:47.222100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0fceb-4a3e-4ffc-bc48-e44ab2c3e6d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:47.248767 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7252c7-d1b0-482c-afc7-b0cd77756fd5 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:47.274380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:47.287992 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:47.301885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0fceb-4a3e-4ffc-bc48-e44ab2c3e6d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:47.303388 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0fceb-4a3e-4ffc-bc48-e44ab2c3e6d0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:47.377350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7252c7-d1b0-482c-afc7-b0cd77756fd5 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:47.423641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 120/246] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:11:47.427443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2217e4-3ce7-426f-8f46-5acbfa166152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:47.428082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2217e4-3ce7-426f-8f46-5acbfa166152 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:47.428358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2217e4-3ce7-426f-8f46-5acbfa166152 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:47.428684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2217e4-3ce7-426f-8f46-5acbfa166152 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:47.430131 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0fceb-4a3e-4ffc-bc48-e44ab2c3e6d0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:47.440925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2217e4-3ce7-426f-8f46-5acbfa166152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:47.446144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-4f2217e4-3ce7-426f-8f46-5acbfa166152 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:47.446144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:47.446144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:47.446144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:47.446144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:47.446144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:47.446144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:47.446144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:47.446144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:47.446144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:47.446144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:47.446144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:47.446144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:47.446144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:47.446144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:47.446144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:47.446987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:47.446987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:47.446987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:47.446987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:47.446987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:47.446987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:47.446987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:47.446987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:47.446987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:47.446987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:47.446987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:47.446987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:47.446987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:47.446987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:47.446987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:47.446987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:47.448727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:47.448727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:47.448727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:47.448727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:47.448727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:47.448727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:47.448727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:47.448727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:47.448727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:47.448727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:47.448727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:47.448727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:11:47.448727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 127/247] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:47.454886 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2217e4-3ce7-426f-8f46-5acbfa166152 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:47.528248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:47.539650 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0fceb-4a3e-4ffc-bc48-e44ab2c3e6d0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:47.574106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:47.575887 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e9803-0141-4a94-9abb-4acedfe951f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:47.576466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e9803-0141-4a94-9abb-4acedfe951f0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:47.576752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e9803-0141-4a94-9abb-4acedfe951f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:47.577026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e9803-0141-4a94-9abb-4acedfe951f0 None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:47.578404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e9803-0141-4a94-9abb-4acedfe951f0 None admin] RBAC: Authorizing `identity:get_project(project_id=f02e08c335f848b3969fbf9251eecd90)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:47.580000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e9803-0141-4a94-9abb-4acedfe951f0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:47.582099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 121/248] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:47 2022] GET /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:47.588018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e9803-0141-4a94-9abb-4acedfe951f0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:47.589967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2217e4-3ce7-426f-8f46-5acbfa166152 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:47.635009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bfabe-6780-48d1-94f2-75308cf87e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:47.635009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bfabe-6780-48d1-94f2-75308cf87e5b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:47.635009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bfabe-6780-48d1-94f2-75308cf87e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:47.635742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bfabe-6780-48d1-94f2-75308cf87e5b None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:47.636660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bfabe-6780-48d1-94f2-75308cf87e5b None admin] RBAC: Adding query filter params (name=member) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:47.637037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bfabe-6780-48d1-94f2-75308cf87e5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:47.639649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bfabe-6780-48d1-94f2-75308cf87e5b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:47.651865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 128/249] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:47.657367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bfabe-6780-48d1-94f2-75308cf87e5b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:47.740348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e9803-0141-4a94-9abb-4acedfe951f0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:47.821939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bfabe-6780-48d1-94f2-75308cf87e5b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:47.823647 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e8fad-0950-41ac-9e5f-e598e4f20671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:47.824348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e8fad-0950-41ac-9e5f-e598e4f20671 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:47.824706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e8fad-0950-41ac-9e5f-e598e4f20671 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:47.825053 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e8fad-0950-41ac-9e5f-e598e4f20671 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:47.825874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e8fad-0950-41ac-9e5f-e598e4f20671 None admin] RBAC: Adding query filter params (role.id=bbb7d9816b1d4ba394a847d12fbe7abf, scope.project.id=f02e08c335f848b3969fbf9251eecd90, user.id=a4b88dc82a664dff83567932a1fcf10e) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:47.826278 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e8fad-0950-41ac-9e5f-e598e4f20671 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:47.828027 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e8fad-0950-41ac-9e5f-e598e4f20671 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:47.833865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 122/250] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:11:47 2022] GET /identity/v3/role_assignments?user.id=a4b88dc82a664dff83567932a1fcf10e&scope.project.id=f02e08c335f848b3969fbf9251eecd90&role.id=bbb7d9816b1d4ba394a847d12fbe7abf => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:47.842421 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfee2e7-1537-4819-974f-dfa9ad8e0c83 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:47.842711 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfee2e7-1537-4819-974f-dfa9ad8e0c83 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:47.843113 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfee2e7-1537-4819-974f-dfa9ad8e0c83 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:47.844565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 123/251] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:47.859062 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e99c47-6318-49ce-a86b-03dc6bfed6be None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:47.859676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e99c47-6318-49ce-a86b-03dc6bfed6be None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:47.859676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e99c47-6318-49ce-a86b-03dc6bfed6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:47.875815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c697961-fd64-458a-9598-77544e46bd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:47.877125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c697961-fd64-458a-9598-77544e46bd30 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:47.877582 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c697961-fd64-458a-9598-77544e46bd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:47.878030 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c697961-fd64-458a-9598-77544e46bd30 None admin] PATH_INFO: `/v3/users/7cd66c02dd8e4418b837b553b90e5b8b` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:47.879806 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c697961-fd64-458a-9598-77544e46bd30 None admin] RBAC: Authorizing `identity:get_user(user_id=7cd66c02dd8e4418b837b553b90e5b8b)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:47.883437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c697961-fd64-458a-9598-77544e46bd30 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:47.890810 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 129/252] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:47 2022] GET /identity/v3/users/7cd66c02dd8e4418b837b553b90e5b8b => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:47.897747 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c697961-fd64-458a-9598-77544e46bd30 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:47.912288 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-39e99c47-6318-49ce-a86b-03dc6bfed6be None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:47.913831 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-39e99c47-6318-49ce-a86b-03dc6bfed6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:47.931198 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:47.966434 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:48.043280 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 124/253] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:11:48.044676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddced8-d538-4242-bf0e-0aa28f4c88ed None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:48.045028 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddced8-d538-4242-bf0e-0aa28f4c88ed None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:48.045376 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddced8-d538-4242-bf0e-0aa28f4c88ed None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:48.051678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 125/254] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:48.058150 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a1266-ef6c-4148-9956-3fe908f741ff None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:48.058498 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a1266-ef6c-4148-9956-3fe908f741ff None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:48.058733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a1266-ef6c-4148-9956-3fe908f741ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:48.068268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c697961-fd64-458a-9598-77544e46bd30 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:48.092578 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-848a1266-ef6c-4148-9956-3fe908f741ff None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:48.093700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-848a1266-ef6c-4148-9956-3fe908f741ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:48.118223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2f696-6756-4853-9d9c-7f9d910fd23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:48.118866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2f696-6756-4853-9d9c-7f9d910fd23a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:48.119144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2f696-6756-4853-9d9c-7f9d910fd23a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:48.120103 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2f696-6756-4853-9d9c-7f9d910fd23a None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:48.121367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2f696-6756-4853-9d9c-7f9d910fd23a None admin] RBAC: Authorizing `identity:get_project(project_id=f02e08c335f848b3969fbf9251eecd90)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:48.122869 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2f696-6756-4853-9d9c-7f9d910fd23a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:48.126208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 130/255] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:47 2022] GET /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:48.134092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2f696-6756-4853-9d9c-7f9d910fd23a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:48.240510 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 126/256] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:48.257154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:48.293842 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2f696-6756-4853-9d9c-7f9d910fd23a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:48.345975 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a953b3a-5422-4b19-94e2-667cfe52c90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:48.346659 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a953b3a-5422-4b19-94e2-667cfe52c90f None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:48.346999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a953b3a-5422-4b19-94e2-667cfe52c90f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:48.347285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a953b3a-5422-4b19-94e2-667cfe52c90f None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90/users/7cd66c02dd8e4418b837b553b90e5b8b/roles/8e4aa52bcd2a47389ee1c5de44fa28ca` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:48.356989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a953b3a-5422-4b19-94e2-667cfe52c90f None admin] RBAC: Authorizing `identity:create_grant(project_id=f02e08c335f848b3969fbf9251eecd90, user_id=7cd66c02dd8e4418b837b553b90e5b8b, role_id=8e4aa52bcd2a47389ee1c5de44fa28ca)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:48.358717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a953b3a-5422-4b19-94e2-667cfe52c90f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:48.387768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 131/257] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:11:48 2022] PUT /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90/users/7cd66c02dd8e4418b837b553b90e5b8b/roles/8e4aa52bcd2a47389ee1c5de44fa28ca => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:11:48.473602 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a1266-ef6c-4148-9956-3fe908f741ff None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:48.585564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:48.609128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a1266-ef6c-4148-9956-3fe908f741ff None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:48.654496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fc75a-bab8-4a69-a4fa-cdae7a754bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:48.655145 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fc75a-bab8-4a69-a4fa-cdae7a754bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:48.655431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fc75a-bab8-4a69-a4fa-cdae7a754bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:48.655704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fc75a-bab8-4a69-a4fa-cdae7a754bb9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:48.673857 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fc75a-bab8-4a69-a4fa-cdae7a754bb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:48.678690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-745fc75a-bab8-4a69-a4fa-cdae7a754bb9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:11:48.678690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:48.678690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:48.678690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:48.678690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:48.678690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:48.678690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:48.678690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:48.678690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:48.678690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:48.678690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:48.678690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:48.678690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:48.678690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:48.678690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:48.678690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:48.679539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:48.679539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:48.679539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:48.679539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:48.679539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:48.679539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:48.679539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:48.679539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:48.679539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:48.679539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:48.679539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:48.679539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:48.679539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:48.679539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:48.679539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:48.679539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:48.680320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:48.680320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:48.680320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:48.680320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:48.680320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:48.680320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:48.680320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:48.680320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:48.680320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:48.680320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:48.680320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:11:48.680320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:48.680320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 127/258] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:11:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:48.686335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a953b3a-5422-4b19-94e2-667cfe52c90f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:48.790189 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fc75a-bab8-4a69-a4fa-cdae7a754bb9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:48.808892 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a953b3a-5422-4b19-94e2-667cfe52c90f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:48.847034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dbcaa-4859-4358-bd5d-0ec2f2624eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:48.847655 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dbcaa-4859-4358-bd5d-0ec2f2624eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:48.847938 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dbcaa-4859-4358-bd5d-0ec2f2624eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:48.848214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dbcaa-4859-4358-bd5d-0ec2f2624eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:48.848891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935dbcaa-4859-4358-bd5d-0ec2f2624eb9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:48.849198 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935dbcaa-4859-4358-bd5d-0ec2f2624eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:48.850941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935dbcaa-4859-4358-bd5d-0ec2f2624eb9 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:48.857486 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:48.861709 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 132/259] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:11:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:48.868593 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dbcaa-4859-4358-bd5d-0ec2f2624eb9 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:48.987746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fc75a-bab8-4a69-a4fa-cdae7a754bb9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:49.051355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dbcaa-4859-4358-bd5d-0ec2f2624eb9 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:49.065895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8001831-7180-42c5-80f8-c9db43735db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:49.066576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8001831-7180-42c5-80f8-c9db43735db2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:49.066962 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8001831-7180-42c5-80f8-c9db43735db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:49.067298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8001831-7180-42c5-80f8-c9db43735db2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:49.102788 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8001831-7180-42c5-80f8-c9db43735db2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:49.105888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbaed5a-888b-44cf-93df-249d7254c229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:49.106560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbaed5a-888b-44cf-93df-249d7254c229 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:49.106847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbaed5a-888b-44cf-93df-249d7254c229 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:49.107126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbaed5a-888b-44cf-93df-249d7254c229 None admin] PATH_INFO: `/v3/users/d29de5b6158442cca418338c0f61090a` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:49.108264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbaed5a-888b-44cf-93df-249d7254c229 None admin] RBAC: Authorizing `identity:get_user(user_id=d29de5b6158442cca418338c0f61090a)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:49.108617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-a8001831-7180-42c5-80f8-c9db43735db2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:49.108617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:49.108617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:49.108617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:49.108617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:49.108617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:49.108617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:49.108617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:49.108617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:49.108617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:49.108617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:49.108617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:49.108617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:49.108617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:49.108617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:49.108617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:49.109463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:49.109463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:49.109463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:49.109463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:49.109463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:49.109463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:49.109463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:49.109463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:49.109463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:49.109463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:49.109463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:49.109463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:49.109463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:49.109463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:49.109463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:49.109463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:49.110283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:49.110283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:49.110283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:49.110283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:49.110283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:49.110283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:49.110283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:49.110283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:49.110283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:49.110283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:49.110283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:11:49.110283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:49.110898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbaed5a-888b-44cf-93df-249d7254c229 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:49.114383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 128/260] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:11:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:11:49.115692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8001831-7180-42c5-80f8-c9db43735db2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:49.117546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 133/261] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:48 2022] GET /identity/v3/users/d29de5b6158442cca418338c0f61090a => generated 283 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:49.120655 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:49.125179 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbaed5a-888b-44cf-93df-249d7254c229 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:49.266424 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:49.286093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8001831-7180-42c5-80f8-c9db43735db2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:49.327682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35caa18b-a86c-4958-9dea-d045c8c1b7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:49.328791 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35caa18b-a86c-4958-9dea-d045c8c1b7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:49.330312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35caa18b-a86c-4958-9dea-d045c8c1b7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:49.331476 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35caa18b-a86c-4958-9dea-d045c8c1b7c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:49.332511 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35caa18b-a86c-4958-9dea-d045c8c1b7c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:49.333481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35caa18b-a86c-4958-9dea-d045c8c1b7c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:49.335256 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35caa18b-a86c-4958-9dea-d045c8c1b7c5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:49.352033 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbaed5a-888b-44cf-93df-249d7254c229 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:49.358622 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 129/262] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:49.364865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35caa18b-a86c-4958-9dea-d045c8c1b7c5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:49.450795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581a077-e3cf-44f4-b2da-b896abb3488a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:49.451764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581a077-e3cf-44f4-b2da-b896abb3488a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:49.452265 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581a077-e3cf-44f4-b2da-b896abb3488a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:49.452729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581a077-e3cf-44f4-b2da-b896abb3488a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:49.481157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:49.556362 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35caa18b-a86c-4958-9dea-d045c8c1b7c5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:49.613515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581a077-e3cf-44f4-b2da-b896abb3488a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:49.615450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581a077-e3cf-44f4-b2da-b896abb3488a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:49.631431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a7ba6-42a3-4159-b4a5-e93781f532db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:49.632081 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a7ba6-42a3-4159-b4a5-e93781f532db None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:49.632362 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a7ba6-42a3-4159-b4a5-e93781f532db None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:49.632634 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a7ba6-42a3-4159-b4a5-e93781f532db None admin] PATH_INFO: `/v3/users/d29de5b6158442cca418338c0f61090a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:49.638086 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a7ba6-42a3-4159-b4a5-e93781f532db None admin] RBAC: Authorizing `identity:get_user(user_id=d29de5b6158442cca418338c0f61090a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:49.638086 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a7ba6-42a3-4159-b4a5-e93781f532db None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:49.639066 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 130/263] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:49 2022] GET /identity/v3/users/d29de5b6158442cca418338c0f61090a => generated 283 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:49.644449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a7ba6-42a3-4159-b4a5-e93781f532db None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:49.742474 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:49.815906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 134/264] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 692 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 16:11:49.821142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581a077-e3cf-44f4-b2da-b896abb3488a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:49.852460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a7ba6-42a3-4159-b4a5-e93781f532db None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:49.886253 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:49.898178 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965b546-6566-4e66-bd66-6d1650602d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:49.898898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965b546-6566-4e66-bd66-6d1650602d25 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:49.899186 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965b546-6566-4e66-bd66-6d1650602d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:49.899621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965b546-6566-4e66-bd66-6d1650602d25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:50.009719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965b546-6566-4e66-bd66-6d1650602d25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:50.012010 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965b546-6566-4e66-bd66-6d1650602d25 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:50.108396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581a077-e3cf-44f4-b2da-b896abb3488a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:50.182787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 131/265] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 16:11:50.184685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2f1ae-ebb4-4af0-b4c1-9a8576dc0d40 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:50.185433 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2f1ae-ebb4-4af0-b4c1-9a8576dc0d40 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:50.186361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2f1ae-ebb4-4af0-b4c1-9a8576dc0d40 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:50.187114 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5c30f-c2db-4adf-b013-2c79a0eb843b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:50.187926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5c30f-c2db-4adf-b013-2c79a0eb843b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:50.188342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5c30f-c2db-4adf-b013-2c79a0eb843b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:50.188753 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5c30f-c2db-4adf-b013-2c79a0eb843b None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:50.190714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 132/266] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:50.191464 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5c30f-c2db-4adf-b013-2c79a0eb843b None admin] RBAC: Authorizing `identity:get_project(project_id=f02e08c335f848b3969fbf9251eecd90)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:50.193158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5c30f-c2db-4adf-b013-2c79a0eb843b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:50.194006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2f1ae-ebb4-4af0-b4c1-9a8576dc0d40 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:50.196752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 135/267] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:49 2022] GET /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90 => generated 302 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:50.200622 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077423f-89ae-4573-8e3b-b7abc88b0913 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:50.202809 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077423f-89ae-4573-8e3b-b7abc88b0913 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:50.203262 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077423f-89ae-4573-8e3b-b7abc88b0913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:50.239398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-3077423f-89ae-4573-8e3b-b7abc88b0913 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:50.240827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-3077423f-89ae-4573-8e3b-b7abc88b0913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:50.261104 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:50.302413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:50.343171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2f1ae-ebb4-4af0-b4c1-9a8576dc0d40 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:50.348732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 136/268] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:50.349581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077423f-89ae-4573-8e3b-b7abc88b0913 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:50.381410 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6e3a0-eefb-45fc-8ac6-63ec5635be7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:50.382216 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6e3a0-eefb-45fc-8ac6-63ec5635be7c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:50.382497 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6e3a0-eefb-45fc-8ac6-63ec5635be7c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:50.382767 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6e3a0-eefb-45fc-8ac6-63ec5635be7c None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:50.384162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6e3a0-eefb-45fc-8ac6-63ec5635be7c None admin] RBAC: Authorizing `identity:get_project(project_id=f02e08c335f848b3969fbf9251eecd90)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:50.386719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6e3a0-eefb-45fc-8ac6-63ec5635be7c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:50.388531 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 133/269] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:50 2022] GET /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:50.394756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469615b5-ee09-4272-b042-0ae9eca62b53 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:50.395044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469615b5-ee09-4272-b042-0ae9eca62b53 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:50.395321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469615b5-ee09-4272-b042-0ae9eca62b53 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:50.397019 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 134/270] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:50.397867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469615b5-ee09-4272-b042-0ae9eca62b53 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:50.567717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077423f-89ae-4573-8e3b-b7abc88b0913 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:50.590446 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:50.600986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469615b5-ee09-4272-b042-0ae9eca62b53 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:50.608909 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062c193-c582-4f2f-9a7d-dc64dbb656a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:50.609745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062c193-c582-4f2f-9a7d-dc64dbb656a2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:50.610201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062c193-c582-4f2f-9a7d-dc64dbb656a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:50.610612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062c193-c582-4f2f-9a7d-dc64dbb656a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:50.611926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062c193-c582-4f2f-9a7d-dc64dbb656a2 None admin] RBAC: Adding query filter params (role.id=41d658f3417e4e48b117d57120991ad8, scope.project.id=f02e08c335f848b3969fbf9251eecd90, user.id=d29de5b6158442cca418338c0f61090a) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:50.612381 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062c193-c582-4f2f-9a7d-dc64dbb656a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:50.613973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062c193-c582-4f2f-9a7d-dc64dbb656a2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:50.621099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 137/271] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:11:50 2022] GET /identity/v3/role_assignments?user.id=d29de5b6158442cca418338c0f61090a&scope.project.id=f02e08c335f848b3969fbf9251eecd90&role.id=41d658f3417e4e48b117d57120991ad8 => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:50.622835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a33dd9-c9c7-449f-976f-1001caa4be04 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:50.623273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a33dd9-c9c7-449f-976f-1001caa4be04 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:50.623873 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a33dd9-c9c7-449f-976f-1001caa4be04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:50.663007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-d8a33dd9-c9c7-449f-976f-1001caa4be04 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:50.664877 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d8a33dd9-c9c7-449f-976f-1001caa4be04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:50.694890 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:50.738474 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a567f-298f-47cc-849b-1f0b460add43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:50.739097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a567f-298f-47cc-849b-1f0b460add43 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:50.739382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a567f-298f-47cc-849b-1f0b460add43 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:50.739658 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a567f-298f-47cc-849b-1f0b460add43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:50.746412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a567f-298f-47cc-849b-1f0b460add43 None admin] RBAC: Adding query filter params (role.id=8de0c87242d7426ea25a510b578c02aa, scope.project.id=f02e08c335f848b3969fbf9251eecd90, user.id=d29de5b6158442cca418338c0f61090a) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:50.746737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a567f-298f-47cc-849b-1f0b460add43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:50.748458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a567f-298f-47cc-849b-1f0b460add43 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:50.749810 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 138/272] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:50.751028 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a33dd9-c9c7-449f-976f-1001caa4be04 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:50.757366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 135/273] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:11:50 2022] GET /identity/v3/role_assignments?user.id=d29de5b6158442cca418338c0f61090a&scope.project.id=f02e08c335f848b3969fbf9251eecd90&role.id=8de0c87242d7426ea25a510b578c02aa => generated 608 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:50.766089 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43e659-d941-49e3-8a5e-137edd01253c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:50.766089 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43e659-d941-49e3-8a5e-137edd01253c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:50.766089 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43e659-d941-49e3-8a5e-137edd01253c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:50.766089 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 136/274] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:50.781804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b2495-3d24-4a03-8444-607fcb29520c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:50.782178 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b2495-3d24-4a03-8444-607fcb29520c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:50.782391 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b2495-3d24-4a03-8444-607fcb29520c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:50.815685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0e8b2495-3d24-4a03-8444-607fcb29520c None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:50.816933 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0e8b2495-3d24-4a03-8444-607fcb29520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:50.955539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a33dd9-c9c7-449f-976f-1001caa4be04 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:50.989124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 137/275] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:11:51.000082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd7f74-0620-4599-9e41-5252605f512a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:51.000997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd7f74-0620-4599-9e41-5252605f512a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:51.001473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd7f74-0620-4599-9e41-5252605f512a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:51.001960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd7f74-0620-4599-9e41-5252605f512a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:51.013716 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd7f74-0620-4599-9e41-5252605f512a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:51.018920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-06cd7f74-0620-4599-9e41-5252605f512a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:51.018920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:51.018920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:51.018920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:51.018920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:51.018920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:51.018920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:51.018920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:51.018920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:51.018920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:51.018920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:51.018920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:51.018920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:51.018920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:51.018920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:51.018920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:51.019773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:51.019773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:51.019773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:51.019773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:51.019773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:51.019773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:51.019773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:51.019773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:51.019773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:51.019773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:51.019773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:51.019773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:51.019773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:51.019773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:51.019773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:51.019773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:51.020568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:51.020568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:51.020568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:51.020568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:51.020568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:51.020568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:51.020568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:51.020568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:51.020568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:51.020568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:51.020568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:51.020568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:11:51.022967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 139/276] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:51.029733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b2495-3d24-4a03-8444-607fcb29520c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:51.112196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd7f74-0620-4599-9e41-5252605f512a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:51.148173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:51.153503 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:51.164132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b2495-3d24-4a03-8444-607fcb29520c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:51.209329 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdae0ce-2cff-412a-9fa6-7e07b7632f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:51.209966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdae0ce-2cff-412a-9fa6-7e07b7632f1b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:51.210766 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdae0ce-2cff-412a-9fa6-7e07b7632f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:51.211047 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdae0ce-2cff-412a-9fa6-7e07b7632f1b None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:51.211997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdae0ce-2cff-412a-9fa6-7e07b7632f1b None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:51.212306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdae0ce-2cff-412a-9fa6-7e07b7632f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:51.215397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdae0ce-2cff-412a-9fa6-7e07b7632f1b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:51.228398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 138/277] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:51.230273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e0328-efe4-499d-a20f-60302b5ff394 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:51.230577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e0328-efe4-499d-a20f-60302b5ff394 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:51.230836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e0328-efe4-499d-a20f-60302b5ff394 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:51.232124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 139/278] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:51.237215 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e0328-efe4-499d-a20f-60302b5ff394 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:51.246536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd7f74-0620-4599-9e41-5252605f512a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:51.281299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2d1bd-0d65-4e88-a836-3b236c591872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:51.282404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2d1bd-0d65-4e88-a836-3b236c591872 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:51.282689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2d1bd-0d65-4e88-a836-3b236c591872 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:51.282966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2d1bd-0d65-4e88-a836-3b236c591872 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:51.284339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2d1bd-0d65-4e88-a836-3b236c591872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:51.285788 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2d1bd-0d65-4e88-a836-3b236c591872 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:51.287530 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 140/279] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:51.291643 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af066ea-c0c1-4804-82db-fae8879d978f None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:51.292119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af066ea-c0c1-4804-82db-fae8879d978f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:51.292357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af066ea-c0c1-4804-82db-fae8879d978f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:51.310529 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-2af066ea-c0c1-4804-82db-fae8879d978f None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:51.311728 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-2af066ea-c0c1-4804-82db-fae8879d978f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:51.348352 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e0328-efe4-499d-a20f-60302b5ff394 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:51.378792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 141/280] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:51.379607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af066ea-c0c1-4804-82db-fae8879d978f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:51.391857 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e335662-61d7-44eb-9892-c82dcfc0d2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:51.392625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e335662-61d7-44eb-9892-c82dcfc0d2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:51.392911 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e335662-61d7-44eb-9892-c82dcfc0d2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:51.393191 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e335662-61d7-44eb-9892-c82dcfc0d2c7 None admin] PATH_INFO: `/v3/users/1468fadb68714effb65979a61f3b0403` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:51.398188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:51.410146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e335662-61d7-44eb-9892-c82dcfc0d2c7 None admin] RBAC: Authorizing `identity:get_user(user_id=1468fadb68714effb65979a61f3b0403)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:51.411624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e335662-61d7-44eb-9892-c82dcfc0d2c7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:51.418235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 140/281] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:51 2022] GET /identity/v3/users/1468fadb68714effb65979a61f3b0403 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:51.418235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e335662-61d7-44eb-9892-c82dcfc0d2c7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:51.428934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:51.488343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af066ea-c0c1-4804-82db-fae8879d978f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:51.524190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bba5b-3076-4165-99cc-5b6915c3d157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:51.524794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bba5b-3076-4165-99cc-5b6915c3d157 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:51.525077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bba5b-3076-4165-99cc-5b6915c3d157 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:51.525350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bba5b-3076-4165-99cc-5b6915c3d157 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:51.526782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50bba5b-3076-4165-99cc-5b6915c3d157 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:51.527160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e335662-61d7-44eb-9892-c82dcfc0d2c7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:51.528240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50bba5b-3076-4165-99cc-5b6915c3d157 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:51.557667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 142/282] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 16:11:51 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:11:51.558327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bba5b-3076-4165-99cc-5b6915c3d157 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:51.580121 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518c48f-30c1-489f-ba91-f140a2354f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:51.581526 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518c48f-30c1-489f-ba91-f140a2354f25 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:51.582094 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518c48f-30c1-489f-ba91-f140a2354f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:51.582607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518c48f-30c1-489f-ba91-f140a2354f25 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:51.599531 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518c48f-30c1-489f-ba91-f140a2354f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:51.606693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-0518c48f-30c1-489f-ba91-f140a2354f25 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:11:51.606693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:51.606693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:51.606693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:51.606693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:51.606693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:51.606693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:51.606693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:51.606693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:51.606693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:51.606693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:51.606693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:51.606693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:51.606693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:51.606693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:51.606693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:51.607835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:51.607835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:51.607835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:51.607835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:51.607835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:51.607835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:51.607835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:51.607835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:51.607835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:51.607835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:51.607835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:51.607835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:51.607835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:51.607835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:51.607835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:51.607835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:51.608803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:51.608803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:51.608803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:51.608803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:51.608803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:51.608803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:51.608803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:51.608803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:51.608803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:51.608803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:51.608803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:11:51.608803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:51.611495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 141/283] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:51.618946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518c48f-30c1-489f-ba91-f140a2354f25 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:51.664630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:51.695676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bba5b-3076-4165-99cc-5b6915c3d157 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:51.717948 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:51.739414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361f204-7050-4e3c-9d7c-7e019392a577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:51.740562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361f204-7050-4e3c-9d7c-7e019392a577 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:51.741179 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361f204-7050-4e3c-9d7c-7e019392a577 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:51.741610 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361f204-7050-4e3c-9d7c-7e019392a577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:51.742966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361f204-7050-4e3c-9d7c-7e019392a577 None admin] RBAC: Adding query filter params (role.id=8e4aa52bcd2a47389ee1c5de44fa28ca, user.id=1468fadb68714effb65979a61f3b0403, scope.system=all) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:51.743283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361f204-7050-4e3c-9d7c-7e019392a577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:51.745200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518c48f-30c1-489f-ba91-f140a2354f25 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:51.745455 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361f204-7050-4e3c-9d7c-7e019392a577 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:51.751551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 143/284] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Aug 23 16:11:51 2022] GET /identity/v3/role_assignments?user.id=1468fadb68714effb65979a61f3b0403&scope.system=all&role.id=8e4aa52bcd2a47389ee1c5de44fa28ca => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:51.752009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361f204-7050-4e3c-9d7c-7e019392a577 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:51.789747 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd90ab-91bd-4843-8438-99480123f9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:51.790418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd90ab-91bd-4843-8438-99480123f9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:51.790697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd90ab-91bd-4843-8438-99480123f9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:51.790966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd90ab-91bd-4843-8438-99480123f9c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:51.792456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd90ab-91bd-4843-8438-99480123f9c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:51.792764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd90ab-91bd-4843-8438-99480123f9c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:51.794222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd90ab-91bd-4843-8438-99480123f9c2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:51.804486 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 142/285] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:51.811125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd90ab-91bd-4843-8438-99480123f9c2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:51.904598 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361f204-7050-4e3c-9d7c-7e019392a577 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:51.949848 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd90ab-91bd-4843-8438-99480123f9c2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:51.954864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c808ae-c33e-4546-8453-667cd022824a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:51.955507 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c808ae-c33e-4546-8453-667cd022824a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:51.955793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c808ae-c33e-4546-8453-667cd022824a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:51.956068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c808ae-c33e-4546-8453-667cd022824a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:51.969599 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:51.976699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c808ae-c33e-4546-8453-667cd022824a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:51.983680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-98c808ae-c33e-4546-8453-667cd022824a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:51.983680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:51.983680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:51.983680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:51.983680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:51.983680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:51.983680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:51.983680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:51.983680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:51.983680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:51.983680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:51.983680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:51.983680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:51.983680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:51.983680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:51.983680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:51.984559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:51.984559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:51.984559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:51.984559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:51.984559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:51.984559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:51.984559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:51.984559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:51.984559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:51.984559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:51.984559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:51.984559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:51.984559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:51.984559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:51.984559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:51.984559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:51.985346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:51.985346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:51.985346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:51.985346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:51.985346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:51.985346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:51.985346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:51.985346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:51.985346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:51.985346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:51.985346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:51.985346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:11:51.986162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 144/286] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:51.991344 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c808ae-c33e-4546-8453-667cd022824a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:51.993456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5491b7-8506-4064-afd3-df5872fbd36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:51.994173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5491b7-8506-4064-afd3-df5872fbd36c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:51.994451 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5491b7-8506-4064-afd3-df5872fbd36c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:51.994731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5491b7-8506-4064-afd3-df5872fbd36c None admin] PATH_INFO: `/v3/users/a4b88dc82a664dff83567932a1fcf10e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:51.995885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5491b7-8506-4064-afd3-df5872fbd36c None admin] RBAC: Authorizing `identity:get_user(user_id=a4b88dc82a664dff83567932a1fcf10e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:51.997513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5491b7-8506-4064-afd3-df5872fbd36c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:51.999554 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 143/287] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:51 2022] GET /identity/v3/users/a4b88dc82a664dff83567932a1fcf10e => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:52.004902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5491b7-8506-4064-afd3-df5872fbd36c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:52.009621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:52.118717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5491b7-8506-4064-afd3-df5872fbd36c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:52.171354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d82989-12b7-4f3d-a9c3-9fb1e16012a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:52.172052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d82989-12b7-4f3d-a9c3-9fb1e16012a3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:52.172342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d82989-12b7-4f3d-a9c3-9fb1e16012a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:52.172617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d82989-12b7-4f3d-a9c3-9fb1e16012a3 None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:52.174609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d82989-12b7-4f3d-a9c3-9fb1e16012a3 None admin] RBAC: Authorizing `identity:get_project(project_id=f02e08c335f848b3969fbf9251eecd90)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:52.176067 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d82989-12b7-4f3d-a9c3-9fb1e16012a3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:52.182960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 144/288] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:52 2022] GET /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:52.183824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d82989-12b7-4f3d-a9c3-9fb1e16012a3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:52.249392 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c808ae-c33e-4546-8453-667cd022824a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:52.301132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:52.320252 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969fe82-f1a8-4365-9efe-9518c8ee0a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:52.320974 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969fe82-f1a8-4365-9efe-9518c8ee0a5b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:52.321267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969fe82-f1a8-4365-9efe-9518c8ee0a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:52.321646 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969fe82-f1a8-4365-9efe-9518c8ee0a5b None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:52.322481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969fe82-f1a8-4365-9efe-9518c8ee0a5b None admin] RBAC: Adding query filter params (name=member) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:52.323422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969fe82-f1a8-4365-9efe-9518c8ee0a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:52.324830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969fe82-f1a8-4365-9efe-9518c8ee0a5b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:52.343622 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 145/289] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:52.345922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d82989-12b7-4f3d-a9c3-9fb1e16012a3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:52.349227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969fe82-f1a8-4365-9efe-9518c8ee0a5b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:52.385370 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8993f-2529-4f53-b421-a46ecdbb7884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:52.386041 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8993f-2529-4f53-b421-a46ecdbb7884 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:52.387826 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8993f-2529-4f53-b421-a46ecdbb7884 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:52.388936 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8993f-2529-4f53-b421-a46ecdbb7884 None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90/users/a4b88dc82a664dff83567932a1fcf10e/roles/bbb7d9816b1d4ba394a847d12fbe7abf` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:52.393676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8993f-2529-4f53-b421-a46ecdbb7884 None admin] RBAC: Authorizing `identity:create_grant(project_id=f02e08c335f848b3969fbf9251eecd90, user_id=a4b88dc82a664dff83567932a1fcf10e, role_id=bbb7d9816b1d4ba394a847d12fbe7abf)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:52.395760 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8993f-2529-4f53-b421-a46ecdbb7884 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:52.429529 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:52.437894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 145/290] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:11:52 2022] PUT /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90/users/a4b88dc82a664dff83567932a1fcf10e/roles/bbb7d9816b1d4ba394a847d12fbe7abf => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:11:52.478021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969fe82-f1a8-4365-9efe-9518c8ee0a5b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:52.516344 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d6f0f-fa3b-4beb-b791-038c499a91f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:52.516979 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d6f0f-fa3b-4beb-b791-038c499a91f2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:52.517266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d6f0f-fa3b-4beb-b791-038c499a91f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:52.517546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d6f0f-fa3b-4beb-b791-038c499a91f2 None admin] PATH_INFO: `/v3/users/7cd66c02dd8e4418b837b553b90e5b8b` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:52.519088 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d6f0f-fa3b-4beb-b791-038c499a91f2 None admin] RBAC: Authorizing `identity:get_user(user_id=7cd66c02dd8e4418b837b553b90e5b8b)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:52.520643 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d6f0f-fa3b-4beb-b791-038c499a91f2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:52.522869 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 146/291] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:52 2022] GET /identity/v3/users/7cd66c02dd8e4418b837b553b90e5b8b => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:52.528802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8993f-2529-4f53-b421-a46ecdbb7884 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:52.669262 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8993f-2529-4f53-b421-a46ecdbb7884 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:52.702120 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:52.707613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b32758-e429-495f-ac28-3b544359ea27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:52.708418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b32758-e429-495f-ac28-3b544359ea27 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:52.709099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b32758-e429-495f-ac28-3b544359ea27 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:52.709443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b32758-e429-495f-ac28-3b544359ea27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:52.780993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b32758-e429-495f-ac28-3b544359ea27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:52.782514 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b32758-e429-495f-ac28-3b544359ea27 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:52.887224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 146/292] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 16:11:52.892432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d6f0f-fa3b-4beb-b791-038c499a91f2 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:53.051058 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d6f0f-fa3b-4beb-b791-038c499a91f2 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:53.091985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:53.105726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f148d1-7249-4b8e-9902-b0b2d7f9238d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:53.106536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f148d1-7249-4b8e-9902-b0b2d7f9238d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:53.106890 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f148d1-7249-4b8e-9902-b0b2d7f9238d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:53.107254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f148d1-7249-4b8e-9902-b0b2d7f9238d None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:53.108717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f148d1-7249-4b8e-9902-b0b2d7f9238d None admin] RBAC: Authorizing `identity:get_project(project_id=f02e08c335f848b3969fbf9251eecd90)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:53.110575 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f148d1-7249-4b8e-9902-b0b2d7f9238d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:53.113677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 147/293] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:52 2022] GET /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:53.118719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b32758-e429-495f-ac28-3b544359ea27 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:53.159372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:53.251233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b32758-e429-495f-ac28-3b544359ea27 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:53.300576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df94ec-b996-4f15-897d-da4d9520267d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:53.301251 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df94ec-b996-4f15-897d-da4d9520267d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:53.301472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df94ec-b996-4f15-897d-da4d9520267d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:53.301746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df94ec-b996-4f15-897d-da4d9520267d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:53.302500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df94ec-b996-4f15-897d-da4d9520267d None admin] RBAC: Adding query filter params (role.id=8e4aa52bcd2a47389ee1c5de44fa28ca, scope.project.id=f02e08c335f848b3969fbf9251eecd90, user.id=7cd66c02dd8e4418b837b553b90e5b8b) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:53.302809 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df94ec-b996-4f15-897d-da4d9520267d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:53.304245 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df94ec-b996-4f15-897d-da4d9520267d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:53.311145 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 147/294] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:11:53 2022] GET /identity/v3/role_assignments?user.id=7cd66c02dd8e4418b837b553b90e5b8b&scope.project.id=f02e08c335f848b3969fbf9251eecd90&role.id=8e4aa52bcd2a47389ee1c5de44fa28ca => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:54.035525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb57a3-ffd6-41b6-a244-b617ca1d2b82 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:54.036033 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb57a3-ffd6-41b6-a244-b617ca1d2b82 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:54.036107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb57a3-ffd6-41b6-a244-b617ca1d2b82 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:54.037684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 148/295] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:54.043340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03be90-6d06-471c-9985-816f2a66519f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:54.043632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03be90-6d06-471c-9985-816f2a66519f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:54.043915 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03be90-6d06-471c-9985-816f2a66519f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:54.062826 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4d03be90-6d06-471c-9985-816f2a66519f None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:54.064026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4d03be90-6d06-471c-9985-816f2a66519f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:54.075454 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be4331-5ca5-41af-9351-a2d84ba31bc3 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:54.075750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be4331-5ca5-41af-9351-a2d84ba31bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:54.076033 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be4331-5ca5-41af-9351-a2d84ba31bc3 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:54.077656 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 149/296] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:54.082632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be5584-929f-43c7-a333-6788a99e3167 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:54.082924 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be5584-929f-43c7-a333-6788a99e3167 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:54.083205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be5584-929f-43c7-a333-6788a99e3167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:54.101338 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-b6be5584-929f-43c7-a333-6788a99e3167 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:54.102592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b6be5584-929f-43c7-a333-6788a99e3167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:54.141915 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 148/297] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:54.186146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 150/298] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:11:54.215127 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb222817-4cb5-4cf4-b0de-adda1b44d20b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:54.215622 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb222817-4cb5-4cf4-b0de-adda1b44d20b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:54.215695 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb222817-4cb5-4cf4-b0de-adda1b44d20b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:54.217244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 149/299] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:54.222781 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df4224-df7d-4ddc-ab64-4248523e5a0a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:54.223077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df4224-df7d-4ddc-ab64-4248523e5a0a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:54.223357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df4224-df7d-4ddc-ab64-4248523e5a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:54.242969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-72df4224-df7d-4ddc-ab64-4248523e5a0a None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:54.244201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-72df4224-df7d-4ddc-ab64-4248523e5a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:54.317608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 151/300] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:54.412440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb222817-4cb5-4cf4-b0de-adda1b44d20b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:54.441814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:54.457416 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df4224-df7d-4ddc-ab64-4248523e5a0a None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:54.519931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb222817-4cb5-4cf4-b0de-adda1b44d20b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:54.534040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:54.555578 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36784d6-0615-46b0-a8c5-58d555f0e0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:54.556215 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36784d6-0615-46b0-a8c5-58d555f0e0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:54.556502 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36784d6-0615-46b0-a8c5-58d555f0e0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:54.557326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36784d6-0615-46b0-a8c5-58d555f0e0d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:54.575036 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36784d6-0615-46b0-a8c5-58d555f0e0d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:54.581521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-a36784d6-0615-46b0-a8c5-58d555f0e0d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:11:54.581521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:54.581521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:54.581521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:54.581521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:54.581521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:54.581521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:54.581521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:54.581521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:54.581521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:54.581521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:54.581521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:54.581521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:54.581521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:54.581521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:54.581521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:54.582405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:54.582405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:54.582405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:54.582405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:54.582405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:54.582405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:54.582405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:54.582405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:54.582405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:54.582405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:54.582405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:54.582405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:54.582405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:54.582405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:54.582405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:54.582405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:54.583190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:54.583190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:54.583190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:54.583190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:54.583190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:54.583190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:54.583190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:54.583190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:54.583190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:54.583190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:54.583190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:11:54.583190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:54.583775 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 150/301] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:54.589993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36784d6-0615-46b0-a8c5-58d555f0e0d6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:54.593935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df4224-df7d-4ddc-ab64-4248523e5a0a None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:54.633074 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ba5ce-5243-419b-8bcf-0b3b130acbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:54.633709 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ba5ce-5243-419b-8bcf-0b3b130acbaa None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:54.633988 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ba5ce-5243-419b-8bcf-0b3b130acbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:54.634286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ba5ce-5243-419b-8bcf-0b3b130acbaa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:54.645470 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ba5ce-5243-419b-8bcf-0b3b130acbaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:54.650287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-c36ba5ce-5243-419b-8bcf-0b3b130acbaa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:54.650287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:54.650287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:54.650287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:54.650287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:54.650287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:54.650287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:54.650287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:54.650287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:54.650287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:54.650287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:54.650287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:54.650287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:54.650287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:54.650287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:54.650287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:54.651849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:54.651849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:54.651849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:54.651849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:54.651849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:54.651849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:54.651849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:54.651849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:54.651849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:54.651849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:54.651849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:54.651849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:54.651849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:54.651849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:54.651849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:54.651849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:54.652645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:54.652645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:54.652645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:54.652645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:54.652645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:54.652645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:54.652645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:54.652645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:54.652645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:54.652645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:54.652645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:54.652645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:11:54.652645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 152/302] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:54.653292 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ba5ce-5243-419b-8bcf-0b3b130acbaa None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:54.685156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:54.701488 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36784d6-0615-46b0-a8c5-58d555f0e0d6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:54.738790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe1af0-a115-4976-95b5-539bbb9542d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:54.739401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe1af0-a115-4976-95b5-539bbb9542d5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:54.739680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe1af0-a115-4976-95b5-539bbb9542d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:54.739957 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe1af0-a115-4976-95b5-539bbb9542d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:54.740744 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe1af0-a115-4976-95b5-539bbb9542d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:54.741088 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe1af0-a115-4976-95b5-539bbb9542d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:54.742636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe1af0-a115-4976-95b5-539bbb9542d5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:54.754237 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 151/303] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:54.754237 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe1af0-a115-4976-95b5-539bbb9542d5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:54.762963 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ba5ce-5243-419b-8bcf-0b3b130acbaa None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:54.779899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:54.798724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4670874-561d-4c43-b0d7-9ac2dd6a3d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:54.799359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4670874-561d-4c43-b0d7-9ac2dd6a3d4f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:54.799640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4670874-561d-4c43-b0d7-9ac2dd6a3d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:54.799911 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4670874-561d-4c43-b0d7-9ac2dd6a3d4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:54.801025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4670874-561d-4c43-b0d7-9ac2dd6a3d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:54.802555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4670874-561d-4c43-b0d7-9ac2dd6a3d4f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:54.804323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 153/304] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:54.806341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4670874-561d-4c43-b0d7-9ac2dd6a3d4f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:54.859027 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe1af0-a115-4976-95b5-539bbb9542d5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:54.892554 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e9cd9-1d0a-4697-9843-f842491fc7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:54.893188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e9cd9-1d0a-4697-9843-f842491fc7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:54.893472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e9cd9-1d0a-4697-9843-f842491fc7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:54.893745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e9cd9-1d0a-4697-9843-f842491fc7a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:54.894447 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e9cd9-1d0a-4697-9843-f842491fc7a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:54.894750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e9cd9-1d0a-4697-9843-f842491fc7a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:54.896128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e9cd9-1d0a-4697-9843-f842491fc7a3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:54.904362 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 152/305] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:54.905501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ea536-7cca-43a8-aa71-b4e1404f6144 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:54.905790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ea536-7cca-43a8-aa71-b4e1404f6144 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:54.906079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ea536-7cca-43a8-aa71-b4e1404f6144 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:54.906193 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4670874-561d-4c43-b0d7-9ac2dd6a3d4f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:54.907284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 153/306] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:54.910863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ea536-7cca-43a8-aa71-b4e1404f6144 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:54.923555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:54.944457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a50f76-a8a9-4a8c-a873-5183ebb4ccfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:54.945095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a50f76-a8a9-4a8c-a873-5183ebb4ccfd None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:54.945373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a50f76-a8a9-4a8c-a873-5183ebb4ccfd None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:54.945647 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a50f76-a8a9-4a8c-a873-5183ebb4ccfd None admin] PATH_INFO: `/v3/users/a352bfc41a464d2186af49702dec10fa` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:54.959324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a50f76-a8a9-4a8c-a873-5183ebb4ccfd None admin] RBAC: Authorizing `identity:get_user(user_id=a352bfc41a464d2186af49702dec10fa)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:54.960775 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a50f76-a8a9-4a8c-a873-5183ebb4ccfd None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:54.962466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 154/307] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:54 2022] GET /identity/v3/users/a352bfc41a464d2186af49702dec10fa => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:54.963406 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a50f76-a8a9-4a8c-a873-5183ebb4ccfd None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:55.009175 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:55.015859 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ea536-7cca-43a8-aa71-b4e1404f6144 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:55.049301 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe438c4f-259c-424f-b8ff-fbf9b5fe5058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:55.049910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe438c4f-259c-424f-b8ff-fbf9b5fe5058 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:55.050226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe438c4f-259c-424f-b8ff-fbf9b5fe5058 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:55.050504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe438c4f-259c-424f-b8ff-fbf9b5fe5058 None admin] PATH_INFO: `/v3/groups` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:55.051120 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe438c4f-259c-424f-b8ff-fbf9b5fe5058 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:55.052543 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe438c4f-259c-424f-b8ff-fbf9b5fe5058 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:55.065712 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a50f76-a8a9-4a8c-a873-5183ebb4ccfd None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:55.068026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 154/308] 10.222.0.16 () {60 vars in 1134 bytes} [Tue Aug 23 16:11:54 2022] POST /identity/v3/groups => generated 229 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:11:55.069269 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb9a34-751a-48cb-8692-3cf984ebbbba None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:55.069560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb9a34-751a-48cb-8692-3cf984ebbbba None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:55.069835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb9a34-751a-48cb-8692-3cf984ebbbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:55.092378 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2fcb9a34-751a-48cb-8692-3cf984ebbbba None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:55.093631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2fcb9a34-751a-48cb-8692-3cf984ebbbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:55.120567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4a006-ca47-42ff-8192-701fa6f57a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:55.121530 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4a006-ca47-42ff-8192-701fa6f57a17 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:55.122016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4a006-ca47-42ff-8192-701fa6f57a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:55.122532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4a006-ca47-42ff-8192-701fa6f57a17 None admin] PATH_INFO: `/v3/users/1468fadb68714effb65979a61f3b0403` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:55.124027 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4a006-ca47-42ff-8192-701fa6f57a17 None admin] RBAC: Authorizing `identity:get_user(user_id=1468fadb68714effb65979a61f3b0403)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:55.125492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4a006-ca47-42ff-8192-701fa6f57a17 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:55.127185 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 155/309] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:54 2022] GET /identity/v3/users/1468fadb68714effb65979a61f3b0403 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:55.128139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4a006-ca47-42ff-8192-701fa6f57a17 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:55.173802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:55.190259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 155/310] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:55.192063 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb9a34-751a-48cb-8692-3cf984ebbbba None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:55.264982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4a006-ca47-42ff-8192-701fa6f57a17 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:55.279613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:55.309803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144b199-a3af-43a8-93e2-58755a50ce47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:55.310452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144b199-a3af-43a8-93e2-58755a50ce47 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:55.310736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144b199-a3af-43a8-93e2-58755a50ce47 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:55.311010 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144b199-a3af-43a8-93e2-58755a50ce47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:55.311742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144b199-a3af-43a8-93e2-58755a50ce47 None admin] RBAC: Adding query filter params (role.id=bbb7d9816b1d4ba394a847d12fbe7abf, user.id=a352bfc41a464d2186af49702dec10fa, scope.system=all) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:55.312057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144b199-a3af-43a8-93e2-58755a50ce47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:55.313517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144b199-a3af-43a8-93e2-58755a50ce47 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:55.319031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 156/311] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Aug 23 16:11:55 2022] GET /identity/v3/role_assignments?user.id=a352bfc41a464d2186af49702dec10fa&scope.system=all&role.id=bbb7d9816b1d4ba394a847d12fbe7abf => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:55.331346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb9a34-751a-48cb-8692-3cf984ebbbba None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:55.374999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2f394-be47-4d7d-9c0b-004be103b0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:55.376041 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2f394-be47-4d7d-9c0b-004be103b0a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:55.376520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2f394-be47-4d7d-9c0b-004be103b0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:55.376990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2f394-be47-4d7d-9c0b-004be103b0a8 None admin] PATH_INFO: `/v3/system/users/1468fadb68714effb65979a61f3b0403/roles/8e4aa52bcd2a47389ee1c5de44fa28ca` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:55.378961 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2f394-be47-4d7d-9c0b-004be103b0a8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1468fadb68714effb65979a61f3b0403, role_id=8e4aa52bcd2a47389ee1c5de44fa28ca)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:55.380601 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2f394-be47-4d7d-9c0b-004be103b0a8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:55.400345 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 156/312] 10.222.0.16 () {58 vars in 1334 bytes} [Tue Aug 23 16:11:55 2022] PUT /identity/v3/system/users/1468fadb68714effb65979a61f3b0403/roles/8e4aa52bcd2a47389ee1c5de44fa28ca => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:11:55.462867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144b199-a3af-43a8-93e2-58755a50ce47 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:55.586589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144b199-a3af-43a8-93e2-58755a50ce47 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:55.623756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910155f-3d37-4304-8662-dd946f1dbd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:55.624391 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910155f-3d37-4304-8662-dd946f1dbd2c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:55.624674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910155f-3d37-4304-8662-dd946f1dbd2c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:55.624949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910155f-3d37-4304-8662-dd946f1dbd2c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:55.637357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910155f-3d37-4304-8662-dd946f1dbd2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:55.642246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-e910155f-3d37-4304-8662-dd946f1dbd2c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:11:55.642246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:55.642246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:55.642246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:55.642246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:55.642246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:55.642246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:55.642246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:55.642246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:55.642246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:55.642246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:55.642246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:55.642246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:55.642246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:55.642246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:55.642246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:55.643124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:55.643124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:55.643124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:55.643124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:55.643124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:55.643124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:55.643124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:55.643124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:55.643124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:55.643124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:55.643124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:55.643124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:55.643124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:55.643124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:55.643124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:55.643124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:55.643927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:55.643927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:55.643927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:55.643927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:55.643927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:55.643927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:55.643927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:55.643927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:55.643927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:55.643927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:55.643927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:11:55.643927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:11:55.643927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 157/313] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:55.649638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2f394-be47-4d7d-9c0b-004be103b0a8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:55.723389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:55.755213 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2f394-be47-4d7d-9c0b-004be103b0a8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:55.790436 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209eea34-a3fb-4418-82a0-678ec0a8cf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:55.791688 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209eea34-a3fb-4418-82a0-678ec0a8cf17 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:55.792023 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209eea34-a3fb-4418-82a0-678ec0a8cf17 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:55.792300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209eea34-a3fb-4418-82a0-678ec0a8cf17 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:55.792970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209eea34-a3fb-4418-82a0-678ec0a8cf17 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:55.793276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209eea34-a3fb-4418-82a0-678ec0a8cf17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:55.794673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209eea34-a3fb-4418-82a0-678ec0a8cf17 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:55.808663 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 157/314] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:55.811211 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910155f-3d37-4304-8662-dd946f1dbd2c None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:55.847188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:55.921465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910155f-3d37-4304-8662-dd946f1dbd2c None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:55.957372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08632390-f93d-430f-be63-cad1409d421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:55.958010 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08632390-f93d-430f-be63-cad1409d421f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:55.958320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08632390-f93d-430f-be63-cad1409d421f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:55.958592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08632390-f93d-430f-be63-cad1409d421f None admin] PATH_INFO: `/v3/users/a4b88dc82a664dff83567932a1fcf10e` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:55.959785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08632390-f93d-430f-be63-cad1409d421f None admin] RBAC: Authorizing `identity:get_user(user_id=a4b88dc82a664dff83567932a1fcf10e)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:55.961246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08632390-f93d-430f-be63-cad1409d421f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:55.968419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 158/315] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:55 2022] GET /identity/v3/users/a4b88dc82a664dff83567932a1fcf10e => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:55.969858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209eea34-a3fb-4418-82a0-678ec0a8cf17 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:56.082926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209eea34-a3fb-4418-82a0-678ec0a8cf17 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:56.110490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:56.118545 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b6145-5f31-4944-b58f-8a1ec2a2a4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:56.119223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b6145-5f31-4944-b58f-8a1ec2a2a4ec None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:56.119491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b6145-5f31-4944-b58f-8a1ec2a2a4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:56.119769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b6145-5f31-4944-b58f-8a1ec2a2a4ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:56.193604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b6145-5f31-4944-b58f-8a1ec2a2a4ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:56.195099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b6145-5f31-4944-b58f-8a1ec2a2a4ec None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:56.306222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 158/316] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:11:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:11:56.308241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08632390-f93d-430f-be63-cad1409d421f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:56.415485 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08632390-f93d-430f-be63-cad1409d421f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:56.417722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:56.454718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c86d67-dbb2-4953-af57-b40016f3bfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:56.455288 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c86d67-dbb2-4953-af57-b40016f3bfb6 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:56.455577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c86d67-dbb2-4953-af57-b40016f3bfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:56.455855 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c86d67-dbb2-4953-af57-b40016f3bfb6 None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:56.457106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c86d67-dbb2-4953-af57-b40016f3bfb6 None admin] RBAC: Authorizing `identity:get_project(project_id=f02e08c335f848b3969fbf9251eecd90)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:56.458733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c86d67-dbb2-4953-af57-b40016f3bfb6 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:56.466200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 159/317] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:11:56 2022] GET /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:56.468515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b6145-5f31-4944-b58f-8a1ec2a2a4ec None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:56.497525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:56.576081 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b6145-5f31-4944-b58f-8a1ec2a2a4ec None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:56.612295 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6b023-1cae-44ed-99f3-781bed3669f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:56.612904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6b023-1cae-44ed-99f3-781bed3669f1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:56.613186 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6b023-1cae-44ed-99f3-781bed3669f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:56.613464 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6b023-1cae-44ed-99f3-781bed3669f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:56.614229 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6b023-1cae-44ed-99f3-781bed3669f1 None admin] RBAC: Adding query filter params (role.id=bbb7d9816b1d4ba394a847d12fbe7abf, scope.project.id=f02e08c335f848b3969fbf9251eecd90, user.id=a4b88dc82a664dff83567932a1fcf10e) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:56.614538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6b023-1cae-44ed-99f3-781bed3669f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:56.615966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6b023-1cae-44ed-99f3-781bed3669f1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:56.626178 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 159/318] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:11:56 2022] GET /identity/v3/role_assignments?user.id=a4b88dc82a664dff83567932a1fcf10e&scope.project.id=f02e08c335f848b3969fbf9251eecd90&role.id=bbb7d9816b1d4ba394a847d12fbe7abf => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:57.178306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea63fd4-24f5-4dfa-8d93-2bcea009e72f None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:57.178673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea63fd4-24f5-4dfa-8d93-2bcea009e72f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:57.178872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea63fd4-24f5-4dfa-8d93-2bcea009e72f None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:57.180204 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 160/319] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:57.186534 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f0ae4-58a1-45ac-a699-0af56deefc68 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:57.186828 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f0ae4-58a1-45ac-a699-0af56deefc68 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:57.187106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f0ae4-58a1-45ac-a699-0af56deefc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:57.205631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c61f0ae4-58a1-45ac-a699-0af56deefc68 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:57.206866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c61f0ae4-58a1-45ac-a699-0af56deefc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:57.274781 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 160/320] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:57.304948 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379ff74-48cc-4545-bb7e-c04b3a1c4151 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:57.305234 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379ff74-48cc-4545-bb7e-c04b3a1c4151 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:57.305681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379ff74-48cc-4545-bb7e-c04b3a1c4151 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:57.307710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 161/321] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:57.313160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f18ee-2f95-4658-96a5-e26f1e150931 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:57.313453 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f18ee-2f95-4658-96a5-e26f1e150931 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:57.313737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f18ee-2f95-4658-96a5-e26f1e150931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:57.331917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-959f18ee-2f95-4658-96a5-e26f1e150931 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:57.333119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-959f18ee-2f95-4658-96a5-e26f1e150931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:57.348361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:57.403508 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 161/322] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:57.433057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e585b0e-9346-46e2-ae97-789395aee05d None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:57.433552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e585b0e-9346-46e2-ae97-789395aee05d None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:57.433552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e585b0e-9346-46e2-ae97-789395aee05d None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:57.435016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 162/323] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:11:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:11:57.440204 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6025f-f147-46a8-8858-7817e77838bc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:57.440494 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6025f-f147-46a8-8858-7817e77838bc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:57.440770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6025f-f147-46a8-8858-7817e77838bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:57.459132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fcc6025f-f147-46a8-8858-7817e77838bc None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:11:57.460305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fcc6025f-f147-46a8-8858-7817e77838bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:11:57.530807 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 162/324] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:11:57.551690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e585b0e-9346-46e2-ae97-789395aee05d None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:57.656480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e585b0e-9346-46e2-ae97-789395aee05d None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:57.674422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6025f-f147-46a8-8858-7817e77838bc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:57.692672 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae2d27-91dd-4261-b1e9-a3ab4514eca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:57.693229 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae2d27-91dd-4261-b1e9-a3ab4514eca0 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:57.693509 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae2d27-91dd-4261-b1e9-a3ab4514eca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:57.693784 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae2d27-91dd-4261-b1e9-a3ab4514eca0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:57.694902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae2d27-91dd-4261-b1e9-a3ab4514eca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:57.696397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae2d27-91dd-4261-b1e9-a3ab4514eca0 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:57.698281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 163/325] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:11:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:57.703424 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae2d27-91dd-4261-b1e9-a3ab4514eca0 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:57.746849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:57.758888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:57.780631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6025f-f147-46a8-8858-7817e77838bc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:57.813503 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae2d27-91dd-4261-b1e9-a3ab4514eca0 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:57.816981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c97756-5056-479f-a317-ae24a5fb5b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:57.817612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c97756-5056-479f-a317-ae24a5fb5b74 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:57.817887 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c97756-5056-479f-a317-ae24a5fb5b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:57.818189 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c97756-5056-479f-a317-ae24a5fb5b74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:57.828854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c97756-5056-479f-a317-ae24a5fb5b74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:57.833577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-00c97756-5056-479f-a317-ae24a5fb5b74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:11:57.833577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:57.833577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:57.833577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:57.833577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:57.833577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:57.833577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:57.833577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:57.833577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:57.833577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:57.833577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:57.833577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:57.833577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:57.833577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:57.833577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:57.833577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:57.834500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:57.834500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:57.834500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:57.834500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:57.834500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:57.834500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:57.834500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:57.834500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:57.834500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:57.834500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:57.834500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:57.834500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:57.834500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:57.834500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:57.834500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:57.834500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:57.835285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:57.835285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:57.835285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:57.835285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:57.835285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:57.835285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:57.835285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:57.835285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:57.835285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:57.835285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:57.835285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:11:57.835285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:57.835285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 163/326] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:11:57.835961 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c97756-5056-479f-a317-ae24a5fb5b74 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:57.851870 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f88ca5-2ea1-40ed-8ca5-3c90b1edfd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:57.852478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f88ca5-2ea1-40ed-8ca5-3c90b1edfd3b None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:57.852759 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f88ca5-2ea1-40ed-8ca5-3c90b1edfd3b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:57.853033 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f88ca5-2ea1-40ed-8ca5-3c90b1edfd3b None admin] PATH_INFO: `/v3/groups` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:57.853800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f88ca5-2ea1-40ed-8ca5-3c90b1edfd3b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:57.855481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f88ca5-2ea1-40ed-8ca5-3c90b1edfd3b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:57.871033 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 164/327] 10.222.0.16 () {60 vars in 1134 bytes} [Tue Aug 23 16:11:57 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:11:57.872160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f88ca5-2ea1-40ed-8ca5-3c90b1edfd3b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:57.952763 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c97756-5056-479f-a317-ae24a5fb5b74 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:57.992126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792abcf-cffd-4b9a-bbd2-98d8219d2fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:57.992771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792abcf-cffd-4b9a-bbd2-98d8219d2fdc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:57.993049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792abcf-cffd-4b9a-bbd2-98d8219d2fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:57.993322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792abcf-cffd-4b9a-bbd2-98d8219d2fdc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:57.994320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:57.998862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f88ca5-2ea1-40ed-8ca5-3c90b1edfd3b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:58.002545 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:58.005906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792abcf-cffd-4b9a-bbd2-98d8219d2fdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:11:58.012032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e792abcf-cffd-4b9a-bbd2-98d8219d2fdc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:58.012032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:11:58.012032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:11:58.012032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:11:58.012032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:11:58.012032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:11:58.012032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:11:58.012032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:11:58.012032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:11:58.012032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:11:58.012032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:11:58.012032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:11:58.012032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:11:58.012032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:11:58.012032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:11:58.012032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:11:58.013106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:11:58.013106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:11:58.013106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:11:58.013106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:11:58.013106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:11:58.013106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:11:58.013106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:11:58.013106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:11:58.013106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:11:58.013106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:11:58.013106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:11:58.013106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:11:58.013106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:11:58.013106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:11:58.013106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:11:58.013106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:11:58.013881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:11:58.013881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:11:58.013881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:11:58.013881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:11:58.013881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:11:58.013881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:11:58.013881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:11:58.013881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:11:58.013881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:11:58.013881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:11:58.013881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:11:58.013881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:11:58.016744 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 164/328] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:11:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:11:58.022881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792abcf-cffd-4b9a-bbd2-98d8219d2fdc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:58.050646 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a55d1-5e4a-4f26-84c6-6e20fe4008a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:58.051527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a55d1-5e4a-4f26-84c6-6e20fe4008a2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:58.051951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a55d1-5e4a-4f26-84c6-6e20fe4008a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:58.052449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a55d1-5e4a-4f26-84c6-6e20fe4008a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:58.053129 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a55d1-5e4a-4f26-84c6-6e20fe4008a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:58.053440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a55d1-5e4a-4f26-84c6-6e20fe4008a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:58.054848 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a55d1-5e4a-4f26-84c6-6e20fe4008a2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:58.064203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 165/329] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:58.069898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a55d1-5e4a-4f26-84c6-6e20fe4008a2 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:58.149501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792abcf-cffd-4b9a-bbd2-98d8219d2fdc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:58.196622 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779fae8-3920-4d73-9d6e-566f64220020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:58.198113 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779fae8-3920-4d73-9d6e-566f64220020 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:58.198406 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779fae8-3920-4d73-9d6e-566f64220020 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:58.198709 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779fae8-3920-4d73-9d6e-566f64220020 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:58.199981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779fae8-3920-4d73-9d6e-566f64220020 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:58.200296 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779fae8-3920-4d73-9d6e-566f64220020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:58.201704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779fae8-3920-4d73-9d6e-566f64220020 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:58.202573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a55d1-5e4a-4f26-84c6-6e20fe4008a2 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:58.214001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 165/330] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:11:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:58.220779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779fae8-3920-4d73-9d6e-566f64220020 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:58.252341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5dd4b-1234-4f78-bdd9-1661beb5319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:58.252964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5dd4b-1234-4f78-bdd9-1661beb5319b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:58.253245 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5dd4b-1234-4f78-bdd9-1661beb5319b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:58.253518 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5dd4b-1234-4f78-bdd9-1661beb5319b None admin] PATH_INFO: `/v3/users/a352bfc41a464d2186af49702dec10fa` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:58.254791 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5dd4b-1234-4f78-bdd9-1661beb5319b None admin] RBAC: Authorizing `identity:get_user(user_id=a352bfc41a464d2186af49702dec10fa)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:58.256377 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5dd4b-1234-4f78-bdd9-1661beb5319b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:58.258175 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 166/331] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:58 2022] GET /identity/v3/users/a352bfc41a464d2186af49702dec10fa => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:11:58.264751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5dd4b-1234-4f78-bdd9-1661beb5319b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:58.297225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:58.301573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:58.347192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779fae8-3920-4d73-9d6e-566f64220020 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:58.390654 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ec196-6299-482a-b247-18a0536742a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:58.391548 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ec196-6299-482a-b247-18a0536742a4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:58.391838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ec196-6299-482a-b247-18a0536742a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:58.392116 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ec196-6299-482a-b247-18a0536742a4 None admin] PATH_INFO: `/v3/users/1468fadb68714effb65979a61f3b0403` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:58.393482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ec196-6299-482a-b247-18a0536742a4 None admin] RBAC: Authorizing `identity:get_user(user_id=1468fadb68714effb65979a61f3b0403)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:58.395008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5dd4b-1234-4f78-bdd9-1661beb5319b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:58.395252 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ec196-6299-482a-b247-18a0536742a4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:58.397659 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 166/332] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:11:58 2022] GET /identity/v3/users/1468fadb68714effb65979a61f3b0403 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:11:58.408027 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ec196-6299-482a-b247-18a0536742a4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:11:58.447134 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693612d-4aa3-4bb8-a0c4-c89f09bf924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:58.449292 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693612d-4aa3-4bb8-a0c4-c89f09bf924a None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:58.449923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693612d-4aa3-4bb8-a0c4-c89f09bf924a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:58.451541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693612d-4aa3-4bb8-a0c4-c89f09bf924a None admin] PATH_INFO: `/v3/system/users/a352bfc41a464d2186af49702dec10fa/roles/bbb7d9816b1d4ba394a847d12fbe7abf` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:58.453404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693612d-4aa3-4bb8-a0c4-c89f09bf924a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a352bfc41a464d2186af49702dec10fa, role_id=bbb7d9816b1d4ba394a847d12fbe7abf)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:58.454823 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693612d-4aa3-4bb8-a0c4-c89f09bf924a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:58.466393 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 167/333] 10.222.0.16 () {58 vars in 1334 bytes} [Tue Aug 23 16:11:58 2022] PUT /identity/v3/system/users/a352bfc41a464d2186af49702dec10fa/roles/bbb7d9816b1d4ba394a847d12fbe7abf => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:11:58.545519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ec196-6299-482a-b247-18a0536742a4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:11:58.579352 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:11:58.585858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24048bc-586e-4227-9dec-fee9d2723091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:11:58.586907 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24048bc-586e-4227-9dec-fee9d2723091 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:11:58.587394 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24048bc-586e-4227-9dec-fee9d2723091 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:11:58.587939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24048bc-586e-4227-9dec-fee9d2723091 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:11:58.589313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24048bc-586e-4227-9dec-fee9d2723091 None admin] RBAC: Adding query filter params (role.id=8e4aa52bcd2a47389ee1c5de44fa28ca, user.id=1468fadb68714effb65979a61f3b0403, scope.system=all) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:11:58.589920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24048bc-586e-4227-9dec-fee9d2723091 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:11:58.591809 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24048bc-586e-4227-9dec-fee9d2723091 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:11:58.606148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 167/334] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Aug 23 16:11:58 2022] GET /identity/v3/role_assignments?user.id=1468fadb68714effb65979a61f3b0403&scope.system=all&role.id=8e4aa52bcd2a47389ee1c5de44fa28ca => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:00.202798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d633cab-3d22-453d-8c2f-a8c81dd64a03 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:00.203666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d633cab-3d22-453d-8c2f-a8c81dd64a03 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:00.203951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d633cab-3d22-453d-8c2f-a8c81dd64a03 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:00.205477 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 168/335] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:00.211174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47fd88-e37d-4f51-b48d-0037f4c52951 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:00.211602 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47fd88-e37d-4f51-b48d-0037f4c52951 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:00.211774 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47fd88-e37d-4f51-b48d-0037f4c52951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:00.239454 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3e47fd88-e37d-4f51-b48d-0037f4c52951 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:00.240691 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3e47fd88-e37d-4f51-b48d-0037f4c52951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:00.319325 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 168/336] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:00.320345 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e0c36-c32f-4c4b-8d30-4501599d657e None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:00.321174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e0c36-c32f-4c4b-8d30-4501599d657e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:00.321880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e0c36-c32f-4c4b-8d30-4501599d657e None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:00.330184 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 169/337] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:00.344364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5907c0c-5ba8-48e1-bf31-365ad850070e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:00.344671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5907c0c-5ba8-48e1-bf31-365ad850070e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:00.344934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5907c0c-5ba8-48e1-bf31-365ad850070e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:00.370844 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d5907c0c-5ba8-48e1-bf31-365ad850070e None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:00.372054 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d5907c0c-5ba8-48e1-bf31-365ad850070e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:00.459086 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 169/338] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:00.665147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e0c36-c32f-4c4b-8d30-4501599d657e None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:00.784847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:00.801236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e0c36-c32f-4c4b-8d30-4501599d657e None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:00.842883 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687d761-082a-4a9e-8f56-6e03bd423080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:00.843864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687d761-082a-4a9e-8f56-6e03bd423080 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:00.844370 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687d761-082a-4a9e-8f56-6e03bd423080 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:00.844839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687d761-082a-4a9e-8f56-6e03bd423080 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:00.859866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687d761-082a-4a9e-8f56-6e03bd423080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:00.865235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-b687d761-082a-4a9e-8f56-6e03bd423080 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:12:00.865235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:00.865235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:00.865235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:00.865235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:00.865235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:00.865235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:00.865235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:00.865235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:00.865235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:00.865235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:00.865235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:00.865235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:00.865235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:00.865235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:00.865235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:00.866247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:00.866247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:00.866247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:00.866247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:00.866247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:00.866247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:00.866247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:00.866247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:00.866247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:00.866247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:00.866247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:00.866247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:00.866247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:00.866247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:00.866247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:00.866247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:00.867031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:00.867031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:00.867031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:00.867031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:00.867031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:00.867031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:00.867031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:00.867031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:00.867031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:00.867031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:00.867031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:12:00.867031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:00.874307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 170/339] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:00.875780 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5907c0c-5ba8-48e1-bf31-365ad850070e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:00.940881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687d761-082a-4a9e-8f56-6e03bd423080 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:00.962515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:01.068533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5907c0c-5ba8-48e1-bf31-365ad850070e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:01.070433 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687d761-082a-4a9e-8f56-6e03bd423080 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:01.109300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29291a69-8dd8-4a6a-977a-2178fba77af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:01.110343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29291a69-8dd8-4a6a-977a-2178fba77af8 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:01.110824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29291a69-8dd8-4a6a-977a-2178fba77af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:01.111294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29291a69-8dd8-4a6a-977a-2178fba77af8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:01.123027 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29291a69-8dd8-4a6a-977a-2178fba77af8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:01.128487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-29291a69-8dd8-4a6a-977a-2178fba77af8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:12:01.128487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:01.128487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:01.128487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:01.128487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:01.128487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:01.128487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:01.128487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:01.128487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:01.128487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:01.128487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:01.128487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:01.128487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:01.128487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:01.128487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:01.128487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:01.129342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:01.129342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:01.129342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:01.129342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:01.129342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:01.129342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:01.129342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:01.129342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:01.129342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:01.129342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:01.129342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:01.129342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:01.129342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:01.129342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:01.129342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:01.129342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:01.130165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:01.130165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:01.130165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:01.130165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:01.130165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:01.130165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:01.130165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:01.130165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:01.130165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:01.130165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:01.130165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:12:01.130165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:01.132694 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 171/340] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:12:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:01.134095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54b768-7c43-40aa-8883-56f0745e2277 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:01.134645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54b768-7c43-40aa-8883-56f0745e2277 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:01.135200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54b768-7c43-40aa-8883-56f0745e2277 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:01.137053 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 172/341] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:01.142193 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54b768-7c43-40aa-8883-56f0745e2277 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:01.142667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e35250-bc1a-4441-b8bb-bcd0e7b0bce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:01.146087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e35250-bc1a-4441-b8bb-bcd0e7b0bce0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:01.146087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e35250-bc1a-4441-b8bb-bcd0e7b0bce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:01.146087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e35250-bc1a-4441-b8bb-bcd0e7b0bce0 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:01.146087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e35250-bc1a-4441-b8bb-bcd0e7b0bce0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:01.146087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e35250-bc1a-4441-b8bb-bcd0e7b0bce0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:01.146429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e35250-bc1a-4441-b8bb-bcd0e7b0bce0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:01.157728 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 170/342] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:12:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:01.159286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4471a9-3cda-4c41-ba4d-f643d8945a3a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:01.159558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4471a9-3cda-4c41-ba4d-f643d8945a3a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:01.160259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4471a9-3cda-4c41-ba4d-f643d8945a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:01.176113 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:01.189232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ca4471a9-3cda-4c41-ba4d-f643d8945a3a None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:01.190724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ca4471a9-3cda-4c41-ba4d-f643d8945a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:01.334113 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 171/343] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:01.335624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4471a9-3cda-4c41-ba4d-f643d8945a3a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:01.360273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54b768-7c43-40aa-8883-56f0745e2277 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:01.397814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:01.405286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4a764-8066-4a4a-b7ca-39f6ca704def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:01.405997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4a764-8066-4a4a-b7ca-39f6ca704def None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:01.406477 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4a764-8066-4a4a-b7ca-39f6ca704def None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:01.406894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4a764-8066-4a4a-b7ca-39f6ca704def None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:01.407725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4a764-8066-4a4a-b7ca-39f6ca704def None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:01.408164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4a764-8066-4a4a-b7ca-39f6ca704def None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:01.410163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4a764-8066-4a4a-b7ca-39f6ca704def None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:01.421229 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 173/344] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:01.426779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444673e-c67d-4596-a008-c53269ea4643 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:01.427251 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444673e-c67d-4596-a008-c53269ea4643 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:01.427651 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444673e-c67d-4596-a008-c53269ea4643 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:01.429318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 174/345] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:01.430890 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444673e-c67d-4596-a008-c53269ea4643 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:01.472609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4471a9-3cda-4c41-ba4d-f643d8945a3a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:01.513958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759fe14-478f-4bdd-8839-3eb900bb8000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:01.515242 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759fe14-478f-4bdd-8839-3eb900bb8000 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:01.515715 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759fe14-478f-4bdd-8839-3eb900bb8000 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:01.516237 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759fe14-478f-4bdd-8839-3eb900bb8000 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:01.556162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:01.592954 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759fe14-478f-4bdd-8839-3eb900bb8000 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:01.594908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759fe14-478f-4bdd-8839-3eb900bb8000 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:01.598937 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444673e-c67d-4596-a008-c53269ea4643 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:01.639798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:01.656086 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bae528-234c-48aa-9dd6-1e7ae355e9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:01.656729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bae528-234c-48aa-9dd6-1e7ae355e9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:01.657288 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bae528-234c-48aa-9dd6-1e7ae355e9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:01.657392 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bae528-234c-48aa-9dd6-1e7ae355e9d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:01.709681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 172/346] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:12:01.715578 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45d3f0-8a7e-4fc2-abc6-9c8a0584fc56 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:01.716434 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45d3f0-8a7e-4fc2-abc6-9c8a0584fc56 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:01.716943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45d3f0-8a7e-4fc2-abc6-9c8a0584fc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:01.739164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1e45d3f0-8a7e-4fc2-abc6-9c8a0584fc56 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:01.740997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1e45d3f0-8a7e-4fc2-abc6-9c8a0584fc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:01.772611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bae528-234c-48aa-9dd6-1e7ae355e9d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:01.777107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bae528-234c-48aa-9dd6-1e7ae355e9d4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:01.832232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 173/347] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:01.833532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45d3f0-8a7e-4fc2-abc6-9c8a0584fc56 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:01.861341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:01.925168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 175/348] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 16:12:01.926045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bae528-234c-48aa-9dd6-1e7ae355e9d4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:01.938908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:01.976663 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45d3f0-8a7e-4fc2-abc6-9c8a0584fc56 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:02.031622 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a1378-8dda-442f-9944-a5ab0b7c70de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:02.032263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a1378-8dda-442f-9944-a5ab0b7c70de None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:02.034220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a1378-8dda-442f-9944-a5ab0b7c70de None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:02.034494 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a1378-8dda-442f-9944-a5ab0b7c70de None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:02.036605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a1378-8dda-442f-9944-a5ab0b7c70de None admin] RBAC: Authorizing `identity:get_project(project_id=f39fd5a3969c4e89ad6198892166ec4d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:02.040957 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a1378-8dda-442f-9944-a5ab0b7c70de None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:02.047065 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 174/349] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:12:01 2022] GET /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:02.047710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a1378-8dda-442f-9944-a5ab0b7c70de None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:02.147552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bae528-234c-48aa-9dd6-1e7ae355e9d4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:02.206267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5423aa0-f081-49dc-9a0f-d74da823a01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:02.207266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5423aa0-f081-49dc-9a0f-d74da823a01e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:02.207739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5423aa0-f081-49dc-9a0f-d74da823a01e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:02.208203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5423aa0-f081-49dc-9a0f-d74da823a01e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:02.225414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5423aa0-f081-49dc-9a0f-d74da823a01e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:02.231203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-e5423aa0-f081-49dc-9a0f-d74da823a01e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:12:02.231203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:02.231203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:02.231203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:02.231203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:02.231203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:02.231203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:02.231203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:02.231203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:02.231203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:02.231203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:02.231203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:02.231203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:02.231203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:02.231203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:02.231203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:02.232115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:02.232115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:02.232115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:02.232115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:02.232115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:02.232115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:02.232115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:02.232115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:02.232115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:02.232115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:02.232115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:02.232115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:02.232115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:02.232115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:02.232115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:02.232115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:02.232917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:02.232917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:02.232917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:02.232917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:02.232917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:02.232917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:02.232917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:02.232917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:02.232917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:02.232917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:02.232917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 16:12:02.232917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:02.237463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 176/350] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:02.238891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5423aa0-f081-49dc-9a0f-d74da823a01e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:02.280079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a1378-8dda-442f-9944-a5ab0b7c70de None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:02.285604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:02.326346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd3660-a860-4407-9cd4-06022a921c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:02.326984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd3660-a860-4407-9cd4-06022a921c61 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:02.327264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd3660-a860-4407-9cd4-06022a921c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:02.327536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd3660-a860-4407-9cd4-06022a921c61 None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:02.328666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd3660-a860-4407-9cd4-06022a921c61 None admin] RBAC: Authorizing `identity:get_project(project_id=f39fd5a3969c4e89ad6198892166ec4d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:02.330116 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd3660-a860-4407-9cd4-06022a921c61 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:02.331806 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 175/351] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:12:02 2022] GET /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:02.332618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd3660-a860-4407-9cd4-06022a921c61 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:02.342960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:02.379023 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5423aa0-f081-49dc-9a0f-d74da823a01e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:02.432014 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ba17f-f741-442a-8e04-82bb7625a18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:02.433042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ba17f-f741-442a-8e04-82bb7625a18b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:02.433479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ba17f-f741-442a-8e04-82bb7625a18b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:02.433885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ba17f-f741-442a-8e04-82bb7625a18b None admin] PATH_INFO: `/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:02.440924 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ba17f-f741-442a-8e04-82bb7625a18b None admin] RBAC: Authorizing `identity:get_group(group_id=d5ef3c66fa7a4994bf45c284f8d7c29c)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:02.442997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ba17f-f741-442a-8e04-82bb7625a18b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:02.450089 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 177/352] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 16:12:02 2022] GET /identity/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:02.451223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ba17f-f741-442a-8e04-82bb7625a18b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:02.472942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd3660-a860-4407-9cd4-06022a921c61 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:02.515944 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac5677-d397-46c3-86b9-b37e617de77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:02.517014 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac5677-d397-46c3-86b9-b37e617de77c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:02.517513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac5677-d397-46c3-86b9-b37e617de77c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:02.517873 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac5677-d397-46c3-86b9-b37e617de77c None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:02.518543 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac5677-d397-46c3-86b9-b37e617de77c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:02.519953 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac5677-d397-46c3-86b9-b37e617de77c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:02.520207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac5677-d397-46c3-86b9-b37e617de77c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:02.530029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 176/353] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:12:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:02.531662 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f4cfa-b939-4999-8522-6d2eb76d60ff None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:02.531970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f4cfa-b939-4999-8522-6d2eb76d60ff None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:02.532214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f4cfa-b939-4999-8522-6d2eb76d60ff None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:02.533796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 177/354] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:02.534416 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f4cfa-b939-4999-8522-6d2eb76d60ff None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:02.588841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:02.593057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ba17f-f741-442a-8e04-82bb7625a18b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:02.628938 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:02.638613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b829b-f804-484a-9eb1-c25cef0efee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:02.639390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b829b-f804-484a-9eb1-c25cef0efee6 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:02.639678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b829b-f804-484a-9eb1-c25cef0efee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:02.639951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b829b-f804-484a-9eb1-c25cef0efee6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:02.652228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b829b-f804-484a-9eb1-c25cef0efee6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:02.660808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-463b829b-f804-484a-9eb1-c25cef0efee6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:12:02.660808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:02.660808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:02.660808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:02.660808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:02.660808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:02.660808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:02.660808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:02.660808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:02.660808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:02.660808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:02.660808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:02.660808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:02.660808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:02.660808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:02.660808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:02.661714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:02.661714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:02.661714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:02.661714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:02.661714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:02.661714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:02.661714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:02.661714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:02.661714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:02.661714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:02.661714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:02.661714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:02.661714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:02.661714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:02.661714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:02.661714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:02.662549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:02.662549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:02.662549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:02.662549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:02.662549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:02.662549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:02.662549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:02.662549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:02.662549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:02.662549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:02.662549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:12:02.662549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:02.663135 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 178/355] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:02.663892 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b829b-f804-484a-9eb1-c25cef0efee6 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:02.672560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f4cfa-b939-4999-8522-6d2eb76d60ff None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:02.715442 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b2581-6cfb-4a8e-9dea-1f51fc26882a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:02.715996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b2581-6cfb-4a8e-9dea-1f51fc26882a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:02.716276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b2581-6cfb-4a8e-9dea-1f51fc26882a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:02.716552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b2581-6cfb-4a8e-9dea-1f51fc26882a None admin] PATH_INFO: `/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:02.717660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b2581-6cfb-4a8e-9dea-1f51fc26882a None admin] RBAC: Authorizing `identity:get_group(group_id=d5ef3c66fa7a4994bf45c284f8d7c29c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:02.719129 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b2581-6cfb-4a8e-9dea-1f51fc26882a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:02.720709 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 178/356] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 16:12:02 2022] GET /identity/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:02.721474 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b2581-6cfb-4a8e-9dea-1f51fc26882a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:02.793819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b829b-f804-484a-9eb1-c25cef0efee6 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:02.834183 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c18cb-b68e-4af8-99f1-7b2c206a5414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:02.834897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c18cb-b68e-4af8-99f1-7b2c206a5414 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:02.835186 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c18cb-b68e-4af8-99f1-7b2c206a5414 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:02.835461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c18cb-b68e-4af8-99f1-7b2c206a5414 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:02.836206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c18cb-b68e-4af8-99f1-7b2c206a5414 None admin] RBAC: Adding query filter params (group.id=d5ef3c66fa7a4994bf45c284f8d7c29c, role.id=8e4aa52bcd2a47389ee1c5de44fa28ca, scope.project.id=f39fd5a3969c4e89ad6198892166ec4d) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:02.836519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c18cb-b68e-4af8-99f1-7b2c206a5414 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:02.838593 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c18cb-b68e-4af8-99f1-7b2c206a5414 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:02.844267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 179/357] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 23 16:12:02 2022] GET /identity/v3/role_assignments?group.id=d5ef3c66fa7a4994bf45c284f8d7c29c&scope.project.id=f39fd5a3969c4e89ad6198892166ec4d&role.id=8e4aa52bcd2a47389ee1c5de44fa28ca => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:02.845457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e373f9-850a-4c78-8b3d-e761cc7e0606 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:02.845744 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e373f9-850a-4c78-8b3d-e761cc7e0606 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:02.846026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e373f9-850a-4c78-8b3d-e761cc7e0606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:02.846711 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b2581-6cfb-4a8e-9dea-1f51fc26882a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:02.868177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-05e373f9-850a-4c78-8b3d-e761cc7e0606 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:02.870111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-05e373f9-850a-4c78-8b3d-e761cc7e0606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:02.893852 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:02.906107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f6695-2078-4c6f-b090-8ff2984ca7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:02.906784 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f6695-2078-4c6f-b090-8ff2984ca7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:02.907093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f6695-2078-4c6f-b090-8ff2984ca7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:02.907654 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f6695-2078-4c6f-b090-8ff2984ca7f0 None admin] PATH_INFO: `/v3/users/a352bfc41a464d2186af49702dec10fa` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:02.909210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f6695-2078-4c6f-b090-8ff2984ca7f0 None admin] RBAC: Authorizing `identity:get_user(user_id=a352bfc41a464d2186af49702dec10fa)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:02.911250 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f6695-2078-4c6f-b090-8ff2984ca7f0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:02.913162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 179/358] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:12:02 2022] GET /identity/v3/users/a352bfc41a464d2186af49702dec10fa => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:02.914201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f6695-2078-4c6f-b090-8ff2984ca7f0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:02.918259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:02.972249 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 180/359] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:02.973263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb4303-3c0c-44a2-ac90-6e19859a51ba None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:02.974211 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb4303-3c0c-44a2-ac90-6e19859a51ba None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:02.974723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb4303-3c0c-44a2-ac90-6e19859a51ba None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:02.976308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 181/360] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:02.977302 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb4303-3c0c-44a2-ac90-6e19859a51ba None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:03.059902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f6695-2078-4c6f-b090-8ff2984ca7f0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:03.100088 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c6838-0c18-4062-b92d-7f3efe1f4b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:03.100291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb4303-3c0c-44a2-ac90-6e19859a51ba None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:03.100699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c6838-0c18-4062-b92d-7f3efe1f4b74 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:03.100980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c6838-0c18-4062-b92d-7f3efe1f4b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:03.101252 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c6838-0c18-4062-b92d-7f3efe1f4b74 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:03.102026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c6838-0c18-4062-b92d-7f3efe1f4b74 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:03.102552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c6838-0c18-4062-b92d-7f3efe1f4b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:03.104896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c6838-0c18-4062-b92d-7f3efe1f4b74 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:03.114762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 180/361] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:12:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:03.115742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c6838-0c18-4062-b92d-7f3efe1f4b74 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:03.138809 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5aae33-6e94-46f1-af71-402779b12dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:03.139477 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5aae33-6e94-46f1-af71-402779b12dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:03.139747 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5aae33-6e94-46f1-af71-402779b12dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:03.140015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5aae33-6e94-46f1-af71-402779b12dc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:03.140847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5aae33-6e94-46f1-af71-402779b12dc3 None admin] RBAC: Adding query filter params (group.id=d5ef3c66fa7a4994bf45c284f8d7c29c, role.id=41d658f3417e4e48b117d57120991ad8, scope.project.id=f39fd5a3969c4e89ad6198892166ec4d) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:03.141151 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5aae33-6e94-46f1-af71-402779b12dc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:03.142800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5aae33-6e94-46f1-af71-402779b12dc3 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:03.149388 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 182/362] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 23 16:12:02 2022] GET /identity/v3/role_assignments?group.id=d5ef3c66fa7a4994bf45c284f8d7c29c&scope.project.id=f39fd5a3969c4e89ad6198892166ec4d&role.id=41d658f3417e4e48b117d57120991ad8 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:03.150905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315eace9-077b-4150-809a-5cfd3c50f67d None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:03.151181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315eace9-077b-4150-809a-5cfd3c50f67d None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:03.151449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315eace9-077b-4150-809a-5cfd3c50f67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:03.176219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-315eace9-077b-4150-809a-5cfd3c50f67d None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:03.176219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-315eace9-077b-4150-809a-5cfd3c50f67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:03.191543 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:03.200087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:03.242410 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c6838-0c18-4062-b92d-7f3efe1f4b74 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:03.257882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 183/363] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:03.259230 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315eace9-077b-4150-809a-5cfd3c50f67d None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:03.289857 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40ddea-e16a-47cb-9248-d92709afbd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:03.290535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40ddea-e16a-47cb-9248-d92709afbd13 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:03.290819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40ddea-e16a-47cb-9248-d92709afbd13 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:03.291651 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40ddea-e16a-47cb-9248-d92709afbd13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:03.292491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40ddea-e16a-47cb-9248-d92709afbd13 None admin] RBAC: Adding query filter params (role.id=bbb7d9816b1d4ba394a847d12fbe7abf, user.id=a352bfc41a464d2186af49702dec10fa, scope.system=all) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:03.293078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40ddea-e16a-47cb-9248-d92709afbd13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:03.294785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40ddea-e16a-47cb-9248-d92709afbd13 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:03.322963 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 181/364] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Aug 23 16:12:03 2022] GET /identity/v3/role_assignments?user.id=a352bfc41a464d2186af49702dec10fa&scope.system=all&role.id=bbb7d9816b1d4ba394a847d12fbe7abf => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:03.383540 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315eace9-077b-4150-809a-5cfd3c50f67d None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:03.422232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc94a0-6c14-4178-b4cf-9b890a67882a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:03.422850 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc94a0-6c14-4178-b4cf-9b890a67882a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:03.423128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc94a0-6c14-4178-b4cf-9b890a67882a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:03.423398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc94a0-6c14-4178-b4cf-9b890a67882a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:03.442454 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:03.456950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40ddea-e16a-47cb-9248-d92709afbd13 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:03.507941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc94a0-6c14-4178-b4cf-9b890a67882a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:03.509441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc94a0-6c14-4178-b4cf-9b890a67882a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:03.659574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 184/365] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:12:03.667174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc94a0-6c14-4178-b4cf-9b890a67882a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:03.692990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40ddea-e16a-47cb-9248-d92709afbd13 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:03.729137 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:03.735065 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:03.758702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2db339-e383-4a21-bd50-67337cebf9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:03.759262 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2db339-e383-4a21-bd50-67337cebf9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:03.759731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2db339-e383-4a21-bd50-67337cebf9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:03.760273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2db339-e383-4a21-bd50-67337cebf9f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:03.794718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2db339-e383-4a21-bd50-67337cebf9f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:03.796223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc94a0-6c14-4178-b4cf-9b890a67882a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:03.800357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-cf2db339-e383-4a21-bd50-67337cebf9f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:12:03.800357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:03.800357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:03.800357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:03.800357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:03.800357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:03.800357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:03.800357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:03.800357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:03.800357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:03.800357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:03.800357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:03.800357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:03.800357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:03.800357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:03.800357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:03.801243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:03.801243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:03.801243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:03.801243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:03.801243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:03.801243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:03.801243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:03.801243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:03.801243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:03.801243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:03.801243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:03.801243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:03.801243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:03.801243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:03.801243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:03.801243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:03.802021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:03.802021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:03.802021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:03.802021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:03.802021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:03.802021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:03.802021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:03.802021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:03.802021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:03.802021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:03.802021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:12:03.802021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:03.802021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 182/366] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:12:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:12:03.816469 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2db339-e383-4a21-bd50-67337cebf9f4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:03.887811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e7510-5123-48a2-b88a-fa895ab9861f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:03.888694 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e7510-5123-48a2-b88a-fa895ab9861f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:03.889117 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e7510-5123-48a2-b88a-fa895ab9861f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:03.889558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e7510-5123-48a2-b88a-fa895ab9861f None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:03.893130 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e7510-5123-48a2-b88a-fa895ab9861f None admin] RBAC: Authorizing `identity:get_project(project_id=f02e08c335f848b3969fbf9251eecd90)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:03.894770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e7510-5123-48a2-b88a-fa895ab9861f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:03.896943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 185/367] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:12:03 2022] GET /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:03.898405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e7510-5123-48a2-b88a-fa895ab9861f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:03.942110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2db339-e383-4a21-bd50-67337cebf9f4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:03.984678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bb63f-9e2e-4897-9953-2b444427e1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:03.985644 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bb63f-9e2e-4897-9953-2b444427e1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:03.986007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bb63f-9e2e-4897-9953-2b444427e1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:03.986494 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bb63f-9e2e-4897-9953-2b444427e1f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:03.987374 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bb63f-9e2e-4897-9953-2b444427e1f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:03.987871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bb63f-9e2e-4897-9953-2b444427e1f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:03.989439 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bb63f-9e2e-4897-9953-2b444427e1f0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:03.999617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 183/368] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:04.000756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bb63f-9e2e-4897-9953-2b444427e1f0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:04.027955 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e7510-5123-48a2-b88a-fa895ab9861f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:04.043991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:04.063218 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:04.065333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203f995-afd7-424b-ac14-98cf6dd385ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:04.066041 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203f995-afd7-424b-ac14-98cf6dd385ef None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:04.067479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203f995-afd7-424b-ac14-98cf6dd385ef None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:04.067974 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203f995-afd7-424b-ac14-98cf6dd385ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:04.080243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203f995-afd7-424b-ac14-98cf6dd385ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:04.085228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-c203f995-afd7-424b-ac14-98cf6dd385ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:12:04.085228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:04.085228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:04.085228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:04.085228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:04.085228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:04.085228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:04.085228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:04.085228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:04.085228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:04.085228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:04.085228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:04.085228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:04.085228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:04.085228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:04.085228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:04.086299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:04.086299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:04.086299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:04.086299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:04.086299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:04.086299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:04.086299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:04.086299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:04.086299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:04.086299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:04.086299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:04.086299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:04.086299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:04.086299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:04.086299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:04.086299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:04.087254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:04.087254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:04.087254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:04.087254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:04.087254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:04.087254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:04.087254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:04.087254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:04.087254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:04.087254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:04.087254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:12:04.087254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:04.089916 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 186/369] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:12:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:04.090994 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203f995-afd7-424b-ac14-98cf6dd385ef None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:04.132507 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bb63f-9e2e-4897-9953-2b444427e1f0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:04.188373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f009b66-183e-4122-83ec-02bee94ca8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:04.189374 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f009b66-183e-4122-83ec-02bee94ca8b6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:04.189851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f009b66-183e-4122-83ec-02bee94ca8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:04.190429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f009b66-183e-4122-83ec-02bee94ca8b6 None admin] PATH_INFO: `/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:04.192036 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f009b66-183e-4122-83ec-02bee94ca8b6 None admin] RBAC: Authorizing `identity:get_group(group_id=d5ef3c66fa7a4994bf45c284f8d7c29c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:04.193667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f009b66-183e-4122-83ec-02bee94ca8b6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:04.196189 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 184/370] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 16:12:03 2022] GET /identity/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:04.197222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f009b66-183e-4122-83ec-02bee94ca8b6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:04.224533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203f995-afd7-424b-ac14-98cf6dd385ef None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:04.270205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcca83-0257-4b9e-8b07-c7465902b36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:04.271182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcca83-0257-4b9e-8b07-c7465902b36d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:04.271655 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcca83-0257-4b9e-8b07-c7465902b36d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:04.272181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcca83-0257-4b9e-8b07-c7465902b36d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:04.326844 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:04.335326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f009b66-183e-4122-83ec-02bee94ca8b6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:04.355005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:04.365980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbcca83-0257-4b9e-8b07-c7465902b36d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:04.367974 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbcca83-0257-4b9e-8b07-c7465902b36d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:04.387805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab50b84-0863-44e9-aaae-17fd05bcf944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:04.388770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab50b84-0863-44e9-aaae-17fd05bcf944 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:04.389254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab50b84-0863-44e9-aaae-17fd05bcf944 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:04.389671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab50b84-0863-44e9-aaae-17fd05bcf944 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:04.390552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab50b84-0863-44e9-aaae-17fd05bcf944 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:04.390997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab50b84-0863-44e9-aaae-17fd05bcf944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:04.392769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab50b84-0863-44e9-aaae-17fd05bcf944 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:04.405608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 185/371] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:04.406811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab50b84-0863-44e9-aaae-17fd05bcf944 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:04.495334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 187/372] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:12:04.497124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcca83-0257-4b9e-8b07-c7465902b36d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:04.529605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab50b84-0863-44e9-aaae-17fd05bcf944 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:04.569085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3dc74-06b2-4a35-abb6-67c06c3e085d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:04.569691 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3dc74-06b2-4a35-abb6-67c06c3e085d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:04.569974 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3dc74-06b2-4a35-abb6-67c06c3e085d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:04.571298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3dc74-06b2-4a35-abb6-67c06c3e085d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:04.572024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3dc74-06b2-4a35-abb6-67c06c3e085d None admin] RBAC: Adding query filter params (group.id=d5ef3c66fa7a4994bf45c284f8d7c29c, role.id=8e4aa52bcd2a47389ee1c5de44fa28ca, scope.project.id=f02e08c335f848b3969fbf9251eecd90) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:04.573030 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3dc74-06b2-4a35-abb6-67c06c3e085d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:04.578478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd3dc74-06b2-4a35-abb6-67c06c3e085d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:04.584040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 186/373] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 23 16:12:04 2022] GET /identity/v3/role_assignments?group.id=d5ef3c66fa7a4994bf45c284f8d7c29c&scope.project.id=f02e08c335f848b3969fbf9251eecd90&role.id=8e4aa52bcd2a47389ee1c5de44fa28ca => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:04.588343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3dc74-06b2-4a35-abb6-67c06c3e085d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:04.601498 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:04.653109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcca83-0257-4b9e-8b07-c7465902b36d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:04.674607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:04.723001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c532beb-07c0-401f-8099-95801141b222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:04.723624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c532beb-07c0-401f-8099-95801141b222 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:04.723910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c532beb-07c0-401f-8099-95801141b222 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:04.724183 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c532beb-07c0-401f-8099-95801141b222 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:04.795364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3dc74-06b2-4a35-abb6-67c06c3e085d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:04.846406 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5e5ae-9319-4572-abb6-682e3acc759d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:04.847149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c532beb-07c0-401f-8099-95801141b222 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:04.847696 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5e5ae-9319-4572-abb6-682e3acc759d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:04.848169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5e5ae-9319-4572-abb6-682e3acc759d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:04.848624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c532beb-07c0-401f-8099-95801141b222 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:04.848811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5e5ae-9319-4572-abb6-682e3acc759d None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:04.850502 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5e5ae-9319-4572-abb6-682e3acc759d None admin] RBAC: Authorizing `identity:get_project(project_id=f02e08c335f848b3969fbf9251eecd90)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:04.852123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5e5ae-9319-4572-abb6-682e3acc759d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:04.854881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 187/374] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:12:04 2022] GET /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:04.879914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5e5ae-9319-4572-abb6-682e3acc759d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:04.935268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:04.963891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 188/375] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:12:04.969742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c532beb-07c0-401f-8099-95801141b222 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:05.037392 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5e5ae-9319-4572-abb6-682e3acc759d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:05.048412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:05.082905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c532beb-07c0-401f-8099-95801141b222 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:05.096497 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebd898-8d2a-486e-9de8-48f32d4cb866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:05.097123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebd898-8d2a-486e-9de8-48f32d4cb866 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:05.097406 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebd898-8d2a-486e-9de8-48f32d4cb866 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:05.097680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebd898-8d2a-486e-9de8-48f32d4cb866 None admin] PATH_INFO: `/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:05.098935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebd898-8d2a-486e-9de8-48f32d4cb866 None admin] RBAC: Authorizing `identity:get_group(group_id=d5ef3c66fa7a4994bf45c284f8d7c29c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:05.100588 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebd898-8d2a-486e-9de8-48f32d4cb866 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:05.102169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 188/376] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 16:12:04 2022] GET /identity/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:05.108555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebd898-8d2a-486e-9de8-48f32d4cb866 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:05.125062 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242258b1-180c-4e41-b19a-78db3bff4c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:05.126198 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242258b1-180c-4e41-b19a-78db3bff4c05 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:05.126706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242258b1-180c-4e41-b19a-78db3bff4c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:05.127245 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242258b1-180c-4e41-b19a-78db3bff4c05 None admin] PATH_INFO: `/v3/projects/062779fbe176490e8964d5f2d8d34b76` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:05.128662 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242258b1-180c-4e41-b19a-78db3bff4c05 None admin] RBAC: Authorizing `identity:get_project(project_id=062779fbe176490e8964d5f2d8d34b76)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:05.130549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242258b1-180c-4e41-b19a-78db3bff4c05 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:05.132467 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 189/377] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:12:04 2022] GET /identity/v3/projects/062779fbe176490e8964d5f2d8d34b76 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:05.138401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242258b1-180c-4e41-b19a-78db3bff4c05 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:05.194880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:05.241557 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebd898-8d2a-486e-9de8-48f32d4cb866 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:05.264410 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242258b1-180c-4e41-b19a-78db3bff4c05 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:05.296669 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895c1d2-c171-4fde-8f01-b1241bdc5248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:05.297563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895c1d2-c171-4fde-8f01-b1241bdc5248 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:05.297991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895c1d2-c171-4fde-8f01-b1241bdc5248 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:05.298511 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895c1d2-c171-4fde-8f01-b1241bdc5248 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:05.299394 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895c1d2-c171-4fde-8f01-b1241bdc5248 None admin] RBAC: Adding query filter params (group.id=d5ef3c66fa7a4994bf45c284f8d7c29c, role.id=41d658f3417e4e48b117d57120991ad8, scope.project.id=f02e08c335f848b3969fbf9251eecd90) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:05.299848 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895c1d2-c171-4fde-8f01-b1241bdc5248 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:05.301724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b40c10-0a8f-4582-a96a-77eefdd71cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:05.301906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895c1d2-c171-4fde-8f01-b1241bdc5248 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:05.302571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b40c10-0a8f-4582-a96a-77eefdd71cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:05.302960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b40c10-0a8f-4582-a96a-77eefdd71cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:05.303333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b40c10-0a8f-4582-a96a-77eefdd71cc3 None admin] PATH_INFO: `/v3/groups/0b19b213eeca46d4a0ea509d7e911038` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:05.318118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 189/378] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 23 16:12:05 2022] GET /identity/v3/role_assignments?group.id=d5ef3c66fa7a4994bf45c284f8d7c29c&scope.project.id=f02e08c335f848b3969fbf9251eecd90&role.id=41d658f3417e4e48b117d57120991ad8 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:05.318337 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b40c10-0a8f-4582-a96a-77eefdd71cc3 None admin] RBAC: Authorizing `identity:get_group(group_id=0b19b213eeca46d4a0ea509d7e911038)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:05.318337 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b40c10-0a8f-4582-a96a-77eefdd71cc3 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:05.318337 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 190/379] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 16:12:05 2022] GET /identity/v3/groups/0b19b213eeca46d4a0ea509d7e911038 => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:05.318822 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b40c10-0a8f-4582-a96a-77eefdd71cc3 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:05.365168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3feaf-5924-4e75-b9f0-cde99d371677 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:05.365453 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3feaf-5924-4e75-b9f0-cde99d371677 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:05.365648 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3feaf-5924-4e75-b9f0-cde99d371677 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:05.370239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 190/380] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:12:05.374209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4fb6c-de9b-42ed-a5ea-41c369736c7d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:05.374497 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4fb6c-de9b-42ed-a5ea-41c369736c7d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:05.374772 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4fb6c-de9b-42ed-a5ea-41c369736c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:05.404746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d7c4fb6c-de9b-42ed-a5ea-41c369736c7d None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:05.405989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d7c4fb6c-de9b-42ed-a5ea-41c369736c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:05.439839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b40c10-0a8f-4582-a96a-77eefdd71cc3 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:05.455006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:05.478521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:05.522042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b46689-529c-460c-bdf0-57433bb9bde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:05.523311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b46689-529c-460c-bdf0-57433bb9bde7 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:05.523791 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b46689-529c-460c-bdf0-57433bb9bde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:05.524206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b46689-529c-460c-bdf0-57433bb9bde7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:05.525117 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b46689-529c-460c-bdf0-57433bb9bde7 None admin] RBAC: Adding query filter params (group.id=0b19b213eeca46d4a0ea509d7e911038, role.id=8de0c87242d7426ea25a510b578c02aa, scope.project.id=062779fbe176490e8964d5f2d8d34b76) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:05.526428 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b46689-529c-460c-bdf0-57433bb9bde7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:05.529590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b46689-529c-460c-bdf0-57433bb9bde7 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:05.544671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 191/381] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 23 16:12:05 2022] GET /identity/v3/role_assignments?group.id=0b19b213eeca46d4a0ea509d7e911038&scope.project.id=062779fbe176490e8964d5f2d8d34b76&role.id=8de0c87242d7426ea25a510b578c02aa => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:05.548713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 191/382] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:12:05.650239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d42457-9c5f-4f4d-8363-7d04569a3da8 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:05.650910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d42457-9c5f-4f4d-8363-7d04569a3da8 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:05.651441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d42457-9c5f-4f4d-8363-7d04569a3da8 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:05.653019 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 192/383] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:05.660324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4920e-9838-4e99-876a-9d057357307d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:05.660864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4920e-9838-4e99-876a-9d057357307d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:05.661291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4920e-9838-4e99-876a-9d057357307d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:05.687235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-30b4920e-9838-4e99-876a-9d057357307d None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:05.688749 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-30b4920e-9838-4e99-876a-9d057357307d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:05.774203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 192/384] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:05.870186 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d42457-9c5f-4f4d-8363-7d04569a3da8 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:05.991355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d42457-9c5f-4f4d-8363-7d04569a3da8 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:06.036794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7acb0-c5ae-4540-89a7-c2ea9ddc802c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:06.037421 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7acb0-c5ae-4540-89a7-c2ea9ddc802c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:06.037702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7acb0-c5ae-4540-89a7-c2ea9ddc802c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:06.037976 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c7acb0-c5ae-4540-89a7-c2ea9ddc802c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:06.049525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c7acb0-c5ae-4540-89a7-c2ea9ddc802c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:06.054495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-c5c7acb0-c5ae-4540-89a7-c2ea9ddc802c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:12:06.054495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:06.054495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:06.054495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:06.054495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:06.054495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:06.054495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:06.054495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:06.054495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:06.054495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:06.054495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:06.054495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:06.054495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:06.054495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:06.054495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:06.054495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:06.055431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:06.055431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:06.055431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:06.055431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:06.055431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:06.055431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:06.055431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:06.055431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:06.055431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:06.055431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:06.055431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:06.055431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:06.055431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:06.055431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:06.055431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:06.055431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:06.056259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:06.056259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:06.056259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:06.056259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:06.056259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:06.056259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:06.056259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:06.056259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:06.056259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:06.056259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:06.056259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:12:06.056259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:06.059623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 193/385] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:06.064573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4920e-9838-4e99-876a-9d057357307d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:06.192480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7acb0-c5ae-4540-89a7-c2ea9ddc802c None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:06.209407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4920e-9838-4e99-876a-9d057357307d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:06.211366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:06.253365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:06.281042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652e391-4e42-4ebe-806e-9dd508d11093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:06.282701 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652e391-4e42-4ebe-806e-9dd508d11093 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:06.283186 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652e391-4e42-4ebe-806e-9dd508d11093 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:06.283933 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652e391-4e42-4ebe-806e-9dd508d11093 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:06.285010 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652e391-4e42-4ebe-806e-9dd508d11093 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:06.286761 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652e391-4e42-4ebe-806e-9dd508d11093 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:06.288633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652e391-4e42-4ebe-806e-9dd508d11093 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:06.311955 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 193/386] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:12:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:06.318579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652e391-4e42-4ebe-806e-9dd508d11093 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:06.395898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c7acb0-c5ae-4540-89a7-c2ea9ddc802c None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:06.455208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0952890-a7b5-4150-9e5e-ff2efb6e13c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:06.456217 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0952890-a7b5-4150-9e5e-ff2efb6e13c1 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:06.456706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0952890-a7b5-4150-9e5e-ff2efb6e13c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:06.457216 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0952890-a7b5-4150-9e5e-ff2efb6e13c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:06.484167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0952890-a7b5-4150-9e5e-ff2efb6e13c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:06.486826 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652e391-4e42-4ebe-806e-9dd508d11093 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:06.490743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-f0952890-a7b5-4150-9e5e-ff2efb6e13c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:12:06.490743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:06.490743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:06.490743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:06.490743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:06.490743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:06.490743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:06.490743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:06.490743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:06.490743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:06.490743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:06.490743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:06.490743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:06.490743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:06.490743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:06.490743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:06.491604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:06.491604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:06.491604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:06.491604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:06.491604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:06.491604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:06.491604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:06.491604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:06.491604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:06.491604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:06.491604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:06.491604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:06.491604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:06.491604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:06.491604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:06.491604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:06.492413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:06.492413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:06.492413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:06.492413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:06.492413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:06.492413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:06.492413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:06.492413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:06.492413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:06.492413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:06.492413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:12:06.492413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:06.500309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 194/387] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:12:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:06.520261 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0952890-a7b5-4150-9e5e-ff2efb6e13c1 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:06.531116 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c25360-df44-48c6-932a-4f5d831271dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:06.531748 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c25360-df44-48c6-932a-4f5d831271dc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:06.532030 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c25360-df44-48c6-932a-4f5d831271dc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:06.532302 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c25360-df44-48c6-932a-4f5d831271dc None admin] PATH_INFO: `/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:06.533674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c25360-df44-48c6-932a-4f5d831271dc None admin] RBAC: Authorizing `identity:get_group(group_id=d5ef3c66fa7a4994bf45c284f8d7c29c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:06.535141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c25360-df44-48c6-932a-4f5d831271dc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:06.542407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 194/388] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 16:12:06 2022] GET /identity/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:06.543297 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c25360-df44-48c6-932a-4f5d831271dc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:06.578787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:06.682130 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0952890-a7b5-4150-9e5e-ff2efb6e13c1 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:06.688445 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:06.725404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c25360-df44-48c6-932a-4f5d831271dc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:06.737382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4a561-e88e-4f3e-8118-ad1161ad113d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:06.738342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4a561-e88e-4f3e-8118-ad1161ad113d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:06.738819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4a561-e88e-4f3e-8118-ad1161ad113d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:06.739277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4a561-e88e-4f3e-8118-ad1161ad113d None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:06.741637 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4a561-e88e-4f3e-8118-ad1161ad113d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:06.742260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4a561-e88e-4f3e-8118-ad1161ad113d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:06.748133 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4a561-e88e-4f3e-8118-ad1161ad113d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:06.768002 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 195/389] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:06.774239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4a561-e88e-4f3e-8118-ad1161ad113d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:06.801355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225ba58-7d06-43a7-ba7a-47b13f12ab2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:06.803693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225ba58-7d06-43a7-ba7a-47b13f12ab2d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:06.804930 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225ba58-7d06-43a7-ba7a-47b13f12ab2d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:06.805398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225ba58-7d06-43a7-ba7a-47b13f12ab2d None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:06.807882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225ba58-7d06-43a7-ba7a-47b13f12ab2d None admin] RBAC: Authorizing `identity:get_project(project_id=f39fd5a3969c4e89ad6198892166ec4d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:06.810913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225ba58-7d06-43a7-ba7a-47b13f12ab2d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:06.816406 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 195/390] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:12:06 2022] GET /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:06.820720 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225ba58-7d06-43a7-ba7a-47b13f12ab2d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:06.959582 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:06.968005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225ba58-7d06-43a7-ba7a-47b13f12ab2d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:06.992098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4a561-e88e-4f3e-8118-ad1161ad113d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:07.018834 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a4603-6709-4a8a-9aeb-d92773e74b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:07.019501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a4603-6709-4a8a-9aeb-d92773e74b90 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:07.019783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a4603-6709-4a8a-9aeb-d92773e74b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:07.020053 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a4603-6709-4a8a-9aeb-d92773e74b90 None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d/groups/d5ef3c66fa7a4994bf45c284f8d7c29c/roles/8e4aa52bcd2a47389ee1c5de44fa28ca` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:07.028513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a4603-6709-4a8a-9aeb-d92773e74b90 None admin] RBAC: Authorizing `identity:create_grant(project_id=f39fd5a3969c4e89ad6198892166ec4d, group_id=d5ef3c66fa7a4994bf45c284f8d7c29c, role_id=8e4aa52bcd2a47389ee1c5de44fa28ca)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:07.029956 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a4603-6709-4a8a-9aeb-d92773e74b90 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:07.052044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 196/391] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Aug 23 16:12:06 2022] PUT /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d/groups/d5ef3c66fa7a4994bf45c284f8d7c29c/roles/8e4aa52bcd2a47389ee1c5de44fa28ca => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:12:07.064056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b999e-f5af-4c0a-a62a-9d9781e4f15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:07.064720 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b999e-f5af-4c0a-a62a-9d9781e4f15f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:07.064999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b999e-f5af-4c0a-a62a-9d9781e4f15f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:07.065269 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b999e-f5af-4c0a-a62a-9d9781e4f15f None admin] PATH_INFO: `/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:07.066542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b999e-f5af-4c0a-a62a-9d9781e4f15f None admin] RBAC: Authorizing `identity:get_group(group_id=d5ef3c66fa7a4994bf45c284f8d7c29c)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:07.068012 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b999e-f5af-4c0a-a62a-9d9781e4f15f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:07.069621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 196/392] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 16:12:06 2022] GET /identity/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c => generated 226 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:07.076877 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a4603-6709-4a8a-9aeb-d92773e74b90 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:07.231542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a4603-6709-4a8a-9aeb-d92773e74b90 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:07.276567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad613a-e254-4757-84d2-14f13eccd2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:07.277292 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad613a-e254-4757-84d2-14f13eccd2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:07.277574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad613a-e254-4757-84d2-14f13eccd2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:07.277849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad613a-e254-4757-84d2-14f13eccd2e7 None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:07.279124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad613a-e254-4757-84d2-14f13eccd2e7 None admin] RBAC: Authorizing `identity:get_project(project_id=f39fd5a3969c4e89ad6198892166ec4d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:07.280523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad613a-e254-4757-84d2-14f13eccd2e7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:07.282203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 197/393] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:12:07 2022] GET /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:07.288244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b999e-f5af-4c0a-a62a-9d9781e4f15f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:07.321774 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:07.418304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b999e-f5af-4c0a-a62a-9d9781e4f15f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:07.454398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaaf084-1c1b-4d92-94b6-2ebac1bb20e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:07.455058 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaf084-1c1b-4d92-94b6-2ebac1bb20e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:07.455337 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaf084-1c1b-4d92-94b6-2ebac1bb20e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:07.455604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaf084-1c1b-4d92-94b6-2ebac1bb20e6 None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d/groups/d5ef3c66fa7a4994bf45c284f8d7c29c/roles/41d658f3417e4e48b117d57120991ad8` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:07.457737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaaf084-1c1b-4d92-94b6-2ebac1bb20e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f39fd5a3969c4e89ad6198892166ec4d, group_id=d5ef3c66fa7a4994bf45c284f8d7c29c, role_id=41d658f3417e4e48b117d57120991ad8)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:07.459214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaaf084-1c1b-4d92-94b6-2ebac1bb20e6 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:07.480952 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 197/394] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Aug 23 16:12:07 2022] PUT /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d/groups/d5ef3c66fa7a4994bf45c284f8d7c29c/roles/41d658f3417e4e48b117d57120991ad8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:12:07.492624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0bd2e-ac98-4432-9d70-f1d3d0bf9df7 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:07.493209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0bd2e-ac98-4432-9d70-f1d3d0bf9df7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:07.493668 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0bd2e-ac98-4432-9d70-f1d3d0bf9df7 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:07.497768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 198/395] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:07.503015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a0458-95ac-43ad-a3ae-5d7daeff730d None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:07.503317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a0458-95ac-43ad-a3ae-5d7daeff730d None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:07.503575 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a0458-95ac-43ad-a3ae-5d7daeff730d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:07.527753 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e96a0458-95ac-43ad-a3ae-5d7daeff730d None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:07.528962 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e96a0458-95ac-43ad-a3ae-5d7daeff730d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:07.613294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 198/396] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:07.629175 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eaa001-dbc9-49c5-b806-827811c7646f None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:07.629713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eaa001-dbc9-49c5-b806-827811c7646f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:07.629713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eaa001-dbc9-49c5-b806-827811c7646f None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:07.632977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 199/397] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:07.649239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b092bc-1e82-4c14-8f4f-0467bbdf9d21 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:07.649563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b092bc-1e82-4c14-8f4f-0467bbdf9d21 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:07.649796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b092bc-1e82-4c14-8f4f-0467bbdf9d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:07.677637 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-99b092bc-1e82-4c14-8f4f-0467bbdf9d21 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:07.678949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-99b092bc-1e82-4c14-8f4f-0467bbdf9d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:07.683307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:07.762853 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 199/398] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:07.958105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eaa001-dbc9-49c5-b806-827811c7646f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:07.995947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:08.068981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b092bc-1e82-4c14-8f4f-0467bbdf9d21 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:08.094852 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eaa001-dbc9-49c5-b806-827811c7646f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:08.134151 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc39826-6633-4c48-a090-e0950ef449a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:08.135578 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc39826-6633-4c48-a090-e0950ef449a3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:08.135946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc39826-6633-4c48-a090-e0950ef449a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:08.136225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc39826-6633-4c48-a090-e0950ef449a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:08.151535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc39826-6633-4c48-a090-e0950ef449a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:08.157624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-9dc39826-6633-4c48-a090-e0950ef449a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:12:08.157624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:08.157624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:08.157624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:08.157624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:08.157624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:08.157624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:08.157624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:08.157624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:08.157624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:08.157624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:08.157624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:08.157624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:08.157624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:08.157624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:08.157624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:08.158922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:08.158922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:08.158922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:08.158922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:08.158922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:08.158922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:08.158922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:08.158922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:08.158922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:08.158922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:08.158922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:08.158922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:08.158922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:08.158922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:08.158922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:08.158922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:08.159704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:08.159704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:08.159704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:08.159704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:08.159704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:08.159704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:08.159704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:08.159704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:08.159704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:08.159704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:08.159704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:12:08.159704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:08.165968 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 200/399] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:08.165968 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc39826-6633-4c48-a090-e0950ef449a3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:08.265839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:08.280354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b092bc-1e82-4c14-8f4f-0467bbdf9d21 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:08.283098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc39826-6633-4c48-a090-e0950ef449a3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:08.322637 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e85a10-45d5-41b9-8b08-b77a9a02d23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:08.323258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e85a10-45d5-41b9-8b08-b77a9a02d23b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:08.323541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e85a10-45d5-41b9-8b08-b77a9a02d23b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:08.323816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e85a10-45d5-41b9-8b08-b77a9a02d23b None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:08.324596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e85a10-45d5-41b9-8b08-b77a9a02d23b None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:08.324907 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e85a10-45d5-41b9-8b08-b77a9a02d23b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:08.326418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e85a10-45d5-41b9-8b08-b77a9a02d23b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:08.332988 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4d0a0-deb4-43c9-9524-f990aa777ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:08.333628 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4d0a0-deb4-43c9-9524-f990aa777ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:08.333912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4d0a0-deb4-43c9-9524-f990aa777ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:08.334219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4d0a0-deb4-43c9-9524-f990aa777ba8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:08.337955 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 201/400] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:12:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:08.341871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e85a10-45d5-41b9-8b08-b77a9a02d23b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:08.352832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:08.356855 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4d0a0-deb4-43c9-9524-f990aa777ba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:08.361620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-53d4d0a0-deb4-43c9-9524-f990aa777ba8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:12:08.361620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:08.361620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:08.361620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:08.361620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:08.361620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:08.361620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:08.361620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:08.361620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:08.361620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:08.361620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:08.361620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:08.361620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:08.361620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:08.361620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:08.361620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:08.362561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:08.362561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:08.362561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:08.362561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:08.362561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:08.362561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:08.362561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:08.362561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:08.362561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:08.362561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:08.362561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:08.362561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:08.362561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:08.362561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:08.362561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:08.362561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:08.363347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:08.363347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:08.363347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:08.363347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:08.363347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:08.363347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:08.363347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:08.363347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:08.363347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:08.363347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:08.363347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:12:08.363347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:08.367145 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 200/401] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:12:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:08.379031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4d0a0-deb4-43c9-9524-f990aa777ba8 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:08.491544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e85a10-45d5-41b9-8b08-b77a9a02d23b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:08.532109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4719b-9efb-425e-9209-c1824e0cbe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:08.532727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4719b-9efb-425e-9209-c1824e0cbe1b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:08.533221 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4719b-9efb-425e-9209-c1824e0cbe1b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:08.533813 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4719b-9efb-425e-9209-c1824e0cbe1b None admin] PATH_INFO: `/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:08.535556 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4719b-9efb-425e-9209-c1824e0cbe1b None admin] RBAC: Authorizing `identity:get_group(group_id=d5ef3c66fa7a4994bf45c284f8d7c29c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:08.536895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4d0a0-deb4-43c9-9524-f990aa777ba8 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:08.537005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4719b-9efb-425e-9209-c1824e0cbe1b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:08.542177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 202/402] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 16:12:08 2022] GET /identity/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:08.543410 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430180c-909c-4097-a1a3-e90074da23a9 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:08.543694 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430180c-909c-4097-a1a3-e90074da23a9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:08.543967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430180c-909c-4097-a1a3-e90074da23a9 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:08.546493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 203/403] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:08.547829 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430180c-909c-4097-a1a3-e90074da23a9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:08.571355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:08.586575 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770d7b6-0e0f-4f84-96ff-6e99deb82fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:08.587433 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770d7b6-0e0f-4f84-96ff-6e99deb82fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:08.588537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770d7b6-0e0f-4f84-96ff-6e99deb82fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:08.589011 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770d7b6-0e0f-4f84-96ff-6e99deb82fd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:08.590000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770d7b6-0e0f-4f84-96ff-6e99deb82fd4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:08.590615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770d7b6-0e0f-4f84-96ff-6e99deb82fd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:08.592200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770d7b6-0e0f-4f84-96ff-6e99deb82fd4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:08.601029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 201/404] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:08.602709 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d877f3-b3e1-40b7-8020-cd594cac0f27 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:08.603194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d877f3-b3e1-40b7-8020-cd594cac0f27 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:08.604303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d877f3-b3e1-40b7-8020-cd594cac0f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:08.624615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-23d877f3-b3e1-40b7-8020-cd594cac0f27 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:08.626274 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-23d877f3-b3e1-40b7-8020-cd594cac0f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:08.671329 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430180c-909c-4097-a1a3-e90074da23a9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:08.688051 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:08.700375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 202/405] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:08.701229 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d877f3-b3e1-40b7-8020-cd594cac0f27 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:08.719118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e252db0-4d55-4c1c-b3ee-bad14317e0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:08.719757 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e252db0-4d55-4c1c-b3ee-bad14317e0eb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:08.720882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e252db0-4d55-4c1c-b3ee-bad14317e0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:08.721340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e252db0-4d55-4c1c-b3ee-bad14317e0eb None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:08.723732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e252db0-4d55-4c1c-b3ee-bad14317e0eb None admin] RBAC: Authorizing `identity:get_project(project_id=f02e08c335f848b3969fbf9251eecd90)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:08.728880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e252db0-4d55-4c1c-b3ee-bad14317e0eb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:08.731034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 204/406] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:12:08 2022] GET /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:08.736847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e252db0-4d55-4c1c-b3ee-bad14317e0eb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:08.857084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:08.885184 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d877f3-b3e1-40b7-8020-cd594cac0f27 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:08.887258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e252db0-4d55-4c1c-b3ee-bad14317e0eb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:08.939465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6044c7-2807-47e3-9591-c2e8ad73df51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:08.940126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6044c7-2807-47e3-9591-c2e8ad73df51 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:08.940405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6044c7-2807-47e3-9591-c2e8ad73df51 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:08.940678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6044c7-2807-47e3-9591-c2e8ad73df51 None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90/groups/d5ef3c66fa7a4994bf45c284f8d7c29c/roles/8e4aa52bcd2a47389ee1c5de44fa28ca` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:08.943205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe9237-1fa1-4948-9568-d31a1bf8fba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:08.943834 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe9237-1fa1-4948-9568-d31a1bf8fba3 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:08.944110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe9237-1fa1-4948-9568-d31a1bf8fba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:08.944383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe9237-1fa1-4948-9568-d31a1bf8fba3 None admin] PATH_INFO: `/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:08.945536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe9237-1fa1-4948-9568-d31a1bf8fba3 None admin] RBAC: Authorizing `identity:get_group(group_id=d5ef3c66fa7a4994bf45c284f8d7c29c)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:08.947004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe9237-1fa1-4948-9568-d31a1bf8fba3 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:08.949174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 203/407] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 16:12:08 2022] GET /identity/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:08.949924 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6044c7-2807-47e3-9591-c2e8ad73df51 None admin] RBAC: Authorizing `identity:create_grant(project_id=f02e08c335f848b3969fbf9251eecd90, group_id=d5ef3c66fa7a4994bf45c284f8d7c29c, role_id=8e4aa52bcd2a47389ee1c5de44fa28ca)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:08.951377 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6044c7-2807-47e3-9591-c2e8ad73df51 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:08.955721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe9237-1fa1-4948-9568-d31a1bf8fba3 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:08.972283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 205/408] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Aug 23 16:12:08 2022] PUT /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90/groups/d5ef3c66fa7a4994bf45c284f8d7c29c/roles/8e4aa52bcd2a47389ee1c5de44fa28ca => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:12:09.039300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6044c7-2807-47e3-9591-c2e8ad73df51 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:09.050778 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:09.101190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe9237-1fa1-4948-9568-d31a1bf8fba3 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:09.184358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126eb576-1de1-4c0c-ad75-ca8860650845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:09.185001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126eb576-1de1-4c0c-ad75-ca8860650845 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:09.185276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126eb576-1de1-4c0c-ad75-ca8860650845 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:09.185541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126eb576-1de1-4c0c-ad75-ca8860650845 None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:09.186697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126eb576-1de1-4c0c-ad75-ca8860650845 None admin] RBAC: Authorizing `identity:get_project(project_id=f02e08c335f848b3969fbf9251eecd90)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:09.188408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126eb576-1de1-4c0c-ad75-ca8860650845 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:09.191364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 204/409] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:12:08 2022] GET /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:09.199827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126eb576-1de1-4c0c-ad75-ca8860650845 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:09.243768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6044c7-2807-47e3-9591-c2e8ad73df51 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:09.298236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe3fd1-d005-423c-b3c1-a25d9a39f9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:09.299926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe3fd1-d005-423c-b3c1-a25d9a39f9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:09.301733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe3fd1-d005-423c-b3c1-a25d9a39f9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:09.304575 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe3fd1-d005-423c-b3c1-a25d9a39f9b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:09.331246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe3fd1-d005-423c-b3c1-a25d9a39f9b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:09.341008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2dfe3fd1-d005-423c-b3c1-a25d9a39f9b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:12:09.341008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:09.341008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:09.341008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:09.341008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:09.341008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:09.341008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:09.341008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:09.341008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:09.341008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:09.341008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:09.341008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:09.341008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:09.341008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:09.341008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:09.341008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:09.342164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:09.342164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:09.342164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:09.342164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:09.342164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:09.342164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:09.342164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:09.342164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:09.342164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:09.342164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:09.342164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:09.342164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:09.342164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:09.342164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:09.342164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:09.342164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:09.343148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:09.343148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:09.343148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:09.343148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:09.343148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:09.343148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:09.343148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:09.343148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:09.343148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:09.343148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:09.343148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:12:09.343148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:09.354390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 206/410] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:12:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:12:09.357520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe3fd1-d005-423c-b3c1-a25d9a39f9b1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:09.361856 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:09.388265 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126eb576-1de1-4c0c-ad75-ca8860650845 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:09.446716 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:09.457403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90547b-aeec-4c40-b183-8b334e73c4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:09.458393 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90547b-aeec-4c40-b183-8b334e73c4d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:09.458873 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90547b-aeec-4c40-b183-8b334e73c4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:09.459331 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90547b-aeec-4c40-b183-8b334e73c4d6 None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90/groups/d5ef3c66fa7a4994bf45c284f8d7c29c/roles/41d658f3417e4e48b117d57120991ad8` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:09.467762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90547b-aeec-4c40-b183-8b334e73c4d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f02e08c335f848b3969fbf9251eecd90, group_id=d5ef3c66fa7a4994bf45c284f8d7c29c, role_id=41d658f3417e4e48b117d57120991ad8)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:09.469450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90547b-aeec-4c40-b183-8b334e73c4d6 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:09.504481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 205/411] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Aug 23 16:12:09 2022] PUT /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90/groups/d5ef3c66fa7a4994bf45c284f8d7c29c/roles/41d658f3417e4e48b117d57120991ad8 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:12:09.517038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe3fd1-d005-423c-b3c1-a25d9a39f9b1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:09.557797 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e019e1-d7ac-400f-97c1-6a797f18ed05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:09.558534 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e019e1-d7ac-400f-97c1-6a797f18ed05 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:09.558817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e019e1-d7ac-400f-97c1-6a797f18ed05 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:09.559134 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e019e1-d7ac-400f-97c1-6a797f18ed05 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:09.559814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e019e1-d7ac-400f-97c1-6a797f18ed05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:09.560117 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e019e1-d7ac-400f-97c1-6a797f18ed05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:09.561647 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e019e1-d7ac-400f-97c1-6a797f18ed05 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:09.571587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 207/412] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:09.577243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90547b-aeec-4c40-b183-8b334e73c4d6 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:09.702631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90547b-aeec-4c40-b183-8b334e73c4d6 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:09.749695 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8db935-a51d-4528-ad5b-35de939b805b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:09.750430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8db935-a51d-4528-ad5b-35de939b805b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:09.750707 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8db935-a51d-4528-ad5b-35de939b805b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:09.750976 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8db935-a51d-4528-ad5b-35de939b805b None admin] PATH_INFO: `/v3/groups/0b19b213eeca46d4a0ea509d7e911038` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:09.752172 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8db935-a51d-4528-ad5b-35de939b805b None admin] RBAC: Authorizing `identity:get_group(group_id=0b19b213eeca46d4a0ea509d7e911038)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:09.753640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8db935-a51d-4528-ad5b-35de939b805b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:09.755271 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 206/413] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 16:12:09 2022] GET /identity/v3/groups/0b19b213eeca46d4a0ea509d7e911038 => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:09.762161 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e019e1-d7ac-400f-97c1-6a797f18ed05 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:09.838682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:09.858552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb63e1f-b206-4645-9659-91ad11d4f765 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:09.858869 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb63e1f-b206-4645-9659-91ad11d4f765 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:09.859095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb63e1f-b206-4645-9659-91ad11d4f765 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:09.860756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 207/414] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:12:09.866147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151eeea-6b80-4be7-8455-f8a26e923ec4 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:09.866469 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151eeea-6b80-4be7-8455-f8a26e923ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:09.866731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151eeea-6b80-4be7-8455-f8a26e923ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:09.889621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e151eeea-6b80-4be7-8455-f8a26e923ec4 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:09.890096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e019e1-d7ac-400f-97c1-6a797f18ed05 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:09.890982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e151eeea-6b80-4be7-8455-f8a26e923ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:09.939428 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05577f10-d4dc-45b1-b3ae-027d93fa941d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:09.940053 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05577f10-d4dc-45b1-b3ae-027d93fa941d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:09.940395 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05577f10-d4dc-45b1-b3ae-027d93fa941d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:09.940671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05577f10-d4dc-45b1-b3ae-027d93fa941d None admin] PATH_INFO: `/v3/projects/062779fbe176490e8964d5f2d8d34b76` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:09.942769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05577f10-d4dc-45b1-b3ae-027d93fa941d None admin] RBAC: Authorizing `identity:get_project(project_id=062779fbe176490e8964d5f2d8d34b76)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:09.944231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05577f10-d4dc-45b1-b3ae-027d93fa941d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:09.947223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 208/415] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:12:09 2022] GET /identity/v3/projects/062779fbe176490e8964d5f2d8d34b76 => generated 344 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:09.949277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30c29d-8e68-48e8-81ed-359dc0053230 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:09.949559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30c29d-8e68-48e8-81ed-359dc0053230 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:09.950246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30c29d-8e68-48e8-81ed-359dc0053230 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:09.952069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 209/416] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:09.952973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30c29d-8e68-48e8-81ed-359dc0053230 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:09.957650 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:09.986226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 208/417] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:09.987519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5535bb-a509-4ebf-9154-3fcb41af911e None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:09.987824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5535bb-a509-4ebf-9154-3fcb41af911e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:09.988160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5535bb-a509-4ebf-9154-3fcb41af911e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:10.026681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-bc5535bb-a509-4ebf-9154-3fcb41af911e None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:10.027873 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-bc5535bb-a509-4ebf-9154-3fcb41af911e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:10.082641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30c29d-8e68-48e8-81ed-359dc0053230 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:10.126436 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa5d82-6fc8-4a31-acb8-9efc61603b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:10.127491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa5d82-6fc8-4a31-acb8-9efc61603b2d None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:10.128020 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa5d82-6fc8-4a31-acb8-9efc61603b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:10.128483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa5d82-6fc8-4a31-acb8-9efc61603b2d None admin] PATH_INFO: `/v3/projects/062779fbe176490e8964d5f2d8d34b76/groups/0b19b213eeca46d4a0ea509d7e911038/roles/8de0c87242d7426ea25a510b578c02aa` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:10.130583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa5d82-6fc8-4a31-acb8-9efc61603b2d None admin] RBAC: Authorizing `identity:create_grant(project_id=062779fbe176490e8964d5f2d8d34b76, group_id=0b19b213eeca46d4a0ea509d7e911038, role_id=8de0c87242d7426ea25a510b578c02aa)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:10.132573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa5d82-6fc8-4a31-acb8-9efc61603b2d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:10.136846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:10.154868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 210/418] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Aug 23 16:12:09 2022] PUT /identity/v3/projects/062779fbe176490e8964d5f2d8d34b76/groups/0b19b213eeca46d4a0ea509d7e911038/roles/8de0c87242d7426ea25a510b578c02aa => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:12:10.216981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 209/419] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:10.356590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa5d82-6fc8-4a31-acb8-9efc61603b2d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:10.479125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa5d82-6fc8-4a31-acb8-9efc61603b2d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:10.521577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5535bb-a509-4ebf-9154-3fcb41af911e None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:10.529222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee984255-84ae-4ed0-94f7-3f864d4ac01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:10.529908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee984255-84ae-4ed0-94f7-3f864d4ac01e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:10.530232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee984255-84ae-4ed0-94f7-3f864d4ac01e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:10.530509 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee984255-84ae-4ed0-94f7-3f864d4ac01e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:10.542487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee984255-84ae-4ed0-94f7-3f864d4ac01e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:10.548148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-ee984255-84ae-4ed0-94f7-3f864d4ac01e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:12:10.548148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:10.548148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:10.548148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:10.548148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:10.548148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:10.548148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:10.548148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:10.548148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:10.548148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:10.548148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:10.548148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:10.548148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:10.548148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:10.548148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:10.548148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:10.549140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:10.549140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:10.549140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:10.549140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:10.549140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:10.549140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:10.549140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:10.549140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:10.549140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:10.549140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:10.549140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:10.549140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:10.549140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:10.549140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:10.549140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:10.549140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:10.549960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:10.549960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:10.549960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:10.549960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:10.549960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:10.549960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:10.549960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:10.549960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:10.549960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:10.549960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:10.549960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:12:10.549960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:10.555365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 211/420] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:12:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:10.559244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee984255-84ae-4ed0-94f7-3f864d4ac01e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:10.648397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:10.714601 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee984255-84ae-4ed0-94f7-3f864d4ac01e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:10.728537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5535bb-a509-4ebf-9154-3fcb41af911e None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:10.761194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:10.784084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797ab9d-b69c-4751-b716-89a44efb47e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:10.785486 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797ab9d-b69c-4751-b716-89a44efb47e6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:10.786994 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797ab9d-b69c-4751-b716-89a44efb47e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:10.787443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797ab9d-b69c-4751-b716-89a44efb47e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:10.788976 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797ab9d-b69c-4751-b716-89a44efb47e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:10.789998 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797ab9d-b69c-4751-b716-89a44efb47e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:10.792132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797ab9d-b69c-4751-b716-89a44efb47e6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:10.800712 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694dfb5c-fea7-4f3a-8bb4-edb1ed7cd5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:10.801352 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dfb5c-fea7-4f3a-8bb4-edb1ed7cd5da None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:10.801629 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dfb5c-fea7-4f3a-8bb4-edb1ed7cd5da None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:10.801900 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dfb5c-fea7-4f3a-8bb4-edb1ed7cd5da None admin] PATH_INFO: `/v3/roles/member` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:10.808965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 212/421] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:10.810544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797ab9d-b69c-4751-b716-89a44efb47e6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:10.831086 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694dfb5c-fea7-4f3a-8bb4-edb1ed7cd5da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:10.836016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-694dfb5c-fea7-4f3a-8bb4-edb1ed7cd5da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:12:10.836016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:10.836016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:10.836016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:10.836016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:10.836016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:10.836016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:10.836016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:10.836016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:10.836016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:10.836016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:10.836016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:10.836016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:10.836016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:10.836016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:10.836016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:10.836908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:10.836908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:10.836908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:10.836908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:10.836908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:10.836908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:10.836908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:10.836908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:10.836908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:10.836908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:10.836908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:10.836908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:10.836908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:10.836908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:10.836908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:10.836908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:10.838496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:10.838496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:10.838496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:10.838496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:10.838496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:10.838496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:10.838496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:10.838496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:10.838496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:10.838496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:10.838496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:12:10.838496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:10.838496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 210/422] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:10.842971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694dfb5c-fea7-4f3a-8bb4-edb1ed7cd5da None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:10.928543 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797ab9d-b69c-4751-b716-89a44efb47e6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:10.946786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:10.978538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94582d-c18a-49c6-bfd8-966d06f480bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:10.979625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94582d-c18a-49c6-bfd8-966d06f480bb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:10.980762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94582d-c18a-49c6-bfd8-966d06f480bb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:10.981484 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94582d-c18a-49c6-bfd8-966d06f480bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:11.036442 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694dfb5c-fea7-4f3a-8bb4-edb1ed7cd5da None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:11.078649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2e728-16c7-4c5a-82d7-ce84f31cade4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:11.079257 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2e728-16c7-4c5a-82d7-ce84f31cade4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:11.079530 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2e728-16c7-4c5a-82d7-ce84f31cade4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:11.079798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2e728-16c7-4c5a-82d7-ce84f31cade4 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:11.080459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2e728-16c7-4c5a-82d7-ce84f31cade4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:11.080762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2e728-16c7-4c5a-82d7-ce84f31cade4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:11.082162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2e728-16c7-4c5a-82d7-ce84f31cade4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:11.095329 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 211/423] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:12:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:11.101181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2e728-16c7-4c5a-82d7-ce84f31cade4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:11.139079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94582d-c18a-49c6-bfd8-966d06f480bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:11.140532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94582d-c18a-49c6-bfd8-966d06f480bb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:11.177431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:11.274820 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 213/424] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:12:11.283023 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94582d-c18a-49c6-bfd8-966d06f480bb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:11.299764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2e728-16c7-4c5a-82d7-ce84f31cade4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:11.305793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:11.339413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08818e6-6f76-42ec-ac25-27ec5832d7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:11.340130 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08818e6-6f76-42ec-ac25-27ec5832d7fb None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:11.340412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08818e6-6f76-42ec-ac25-27ec5832d7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:11.340682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08818e6-6f76-42ec-ac25-27ec5832d7fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:11.412367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94582d-c18a-49c6-bfd8-966d06f480bb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:11.428646 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08818e6-6f76-42ec-ac25-27ec5832d7fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:11.430240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08818e6-6f76-42ec-ac25-27ec5832d7fb None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:11.449036 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52010678-ab8c-4e9f-a0c1-3d89cdf3c696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:11.449667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52010678-ab8c-4e9f-a0c1-3d89cdf3c696 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:11.449945 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52010678-ab8c-4e9f-a0c1-3d89cdf3c696 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:11.450236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52010678-ab8c-4e9f-a0c1-3d89cdf3c696 None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:11.451366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52010678-ab8c-4e9f-a0c1-3d89cdf3c696 None admin] RBAC: Authorizing `identity:get_project(project_id=f39fd5a3969c4e89ad6198892166ec4d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:11.452808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52010678-ab8c-4e9f-a0c1-3d89cdf3c696 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:11.454800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 214/425] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:12:11 2022] GET /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:11.456246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700f252-b31d-4ee6-ad8c-da32876c91d2 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:11.456532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700f252-b31d-4ee6-ad8c-da32876c91d2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:11.456803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700f252-b31d-4ee6-ad8c-da32876c91d2 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:11.458181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 215/426] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:11.463506 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700f252-b31d-4ee6-ad8c-da32876c91d2 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:11.475594 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:11.558206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 212/427] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:12:11.559566 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea6f7c-0a5e-4910-b792-5920aee0afa0 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:11.560043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea6f7c-0a5e-4910-b792-5920aee0afa0 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:11.560318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea6f7c-0a5e-4910-b792-5920aee0afa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:11.563688 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:11.583775 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-baea6f7c-0a5e-4910-b792-5920aee0afa0 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:11.584712 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700f252-b31d-4ee6-ad8c-da32876c91d2 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:11.585115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-baea6f7c-0a5e-4910-b792-5920aee0afa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:11.626017 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9765a8-e7dc-4c82-bc07-7ee119d0ae46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:11.626734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9765a8-e7dc-4c82-bc07-7ee119d0ae46 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:11.627074 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9765a8-e7dc-4c82-bc07-7ee119d0ae46 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:11.627349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9765a8-e7dc-4c82-bc07-7ee119d0ae46 None admin] PATH_INFO: `/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:11.628551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9765a8-e7dc-4c82-bc07-7ee119d0ae46 None admin] RBAC: Authorizing `identity:get_group(group_id=d5ef3c66fa7a4994bf45c284f8d7c29c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:11.630103 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9765a8-e7dc-4c82-bc07-7ee119d0ae46 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:11.632025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 216/428] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 16:12:11 2022] GET /identity/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:11.632898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9765a8-e7dc-4c82-bc07-7ee119d0ae46 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:11.672061 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 213/429] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:11.672997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea6f7c-0a5e-4910-b792-5920aee0afa0 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:11.809804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9765a8-e7dc-4c82-bc07-7ee119d0ae46 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:11.811283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:11.881165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea6f7c-0a5e-4910-b792-5920aee0afa0 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:11.883087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050c293-0413-4aa2-a55a-12eec1d17be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:11.883723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c293-0413-4aa2-a55a-12eec1d17be8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:11.883995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c293-0413-4aa2-a55a-12eec1d17be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:11.884322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050c293-0413-4aa2-a55a-12eec1d17be8 None admin] PATH_INFO: `/v3/projects/f39fd5a3969c4e89ad6198892166ec4d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:11.887707 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050c293-0413-4aa2-a55a-12eec1d17be8 None admin] RBAC: Authorizing `identity:get_project(project_id=f39fd5a3969c4e89ad6198892166ec4d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:11.889152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050c293-0413-4aa2-a55a-12eec1d17be8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:11.896698 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 217/430] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:12:11 2022] GET /identity/v3/projects/f39fd5a3969c4e89ad6198892166ec4d => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:11.902784 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050c293-0413-4aa2-a55a-12eec1d17be8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:11.937469 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:11.939200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626af56-acfc-4f63-9a56-38b2b4a76e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:11.939867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626af56-acfc-4f63-9a56-38b2b4a76e8a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:11.940275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626af56-acfc-4f63-9a56-38b2b4a76e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:11.940558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626af56-acfc-4f63-9a56-38b2b4a76e8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:11.941333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626af56-acfc-4f63-9a56-38b2b4a76e8a None admin] RBAC: Adding query filter params (group.id=d5ef3c66fa7a4994bf45c284f8d7c29c, role.id=41d658f3417e4e48b117d57120991ad8, scope.project.id=f39fd5a3969c4e89ad6198892166ec4d) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:11.941642 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626af56-acfc-4f63-9a56-38b2b4a76e8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:11.943210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626af56-acfc-4f63-9a56-38b2b4a76e8a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:11.950808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 214/431] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 23 16:12:11 2022] GET /identity/v3/role_assignments?group.id=d5ef3c66fa7a4994bf45c284f8d7c29c&scope.project.id=f39fd5a3969c4e89ad6198892166ec4d&role.id=41d658f3417e4e48b117d57120991ad8 => generated 611 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:11.996328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626af56-acfc-4f63-9a56-38b2b4a76e8a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:12.086934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050c293-0413-4aa2-a55a-12eec1d17be8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:12.132746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760ee2f-6516-47bd-a8d4-5be08b23665e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:12.133693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760ee2f-6516-47bd-a8d4-5be08b23665e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:12.133977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760ee2f-6516-47bd-a8d4-5be08b23665e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:12.135169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760ee2f-6516-47bd-a8d4-5be08b23665e None admin] PATH_INFO: `/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:12.137841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760ee2f-6516-47bd-a8d4-5be08b23665e None admin] RBAC: Authorizing `identity:get_group(group_id=d5ef3c66fa7a4994bf45c284f8d7c29c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:12.139482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760ee2f-6516-47bd-a8d4-5be08b23665e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:12.140371 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626af56-acfc-4f63-9a56-38b2b4a76e8a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:12.141370 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 218/432] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 16:12:11 2022] GET /identity/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:12.142556 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c77ba-850b-4471-83d5-06e28b652584 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:12.142836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c77ba-850b-4471-83d5-06e28b652584 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:12.143107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c77ba-850b-4471-83d5-06e28b652584 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:12.147070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 219/433] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:12.147070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c77ba-850b-4471-83d5-06e28b652584 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:12.185118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:12.190713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b75280-578a-4cb0-9674-b05d56b495ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:12.191441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b75280-578a-4cb0-9674-b05d56b495ff None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:12.191717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b75280-578a-4cb0-9674-b05d56b495ff None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:12.191983 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b75280-578a-4cb0-9674-b05d56b495ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:12.205407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b75280-578a-4cb0-9674-b05d56b495ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:12.211692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-10b75280-578a-4cb0-9674-b05d56b495ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:12:12.211692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:12.211692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:12.211692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:12.211692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:12.211692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:12.211692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:12.211692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:12.211692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:12.211692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:12.211692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:12.211692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:12.211692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:12.211692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:12.211692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:12.211692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:12.212604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:12.212604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:12.212604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:12.212604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:12.212604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:12.212604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:12.212604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:12.212604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:12.212604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:12.212604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:12.212604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:12.212604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:12.212604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:12.212604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:12.212604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:12.212604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:12.213638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:12.213638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:12.213638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:12.213638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:12.213638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:12.213638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:12.213638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:12.213638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:12.213638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:12.213638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:12.213638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 16:12:12.213638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:12.213638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 215/434] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:12:12.214384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b4d1c-ac14-4c7e-8353-ca025dbd2056 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:12.214960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b4d1c-ac14-4c7e-8353-ca025dbd2056 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:12.214960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b4d1c-ac14-4c7e-8353-ca025dbd2056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:12.236783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-937b4d1c-ac14-4c7e-8353-ca025dbd2056 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:12.238318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-937b4d1c-ac14-4c7e-8353-ca025dbd2056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:12.260771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:12.272985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c77ba-850b-4471-83d5-06e28b652584 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:12.308226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1f114-856d-4a4b-b7bc-9f8511c3ccdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:12.308836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1f114-856d-4a4b-b7bc-9f8511c3ccdc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:12.309118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1f114-856d-4a4b-b7bc-9f8511c3ccdc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:12.309391 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1f114-856d-4a4b-b7bc-9f8511c3ccdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:12.310143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1f114-856d-4a4b-b7bc-9f8511c3ccdc None admin] RBAC: Adding query filter params (group.id=d5ef3c66fa7a4994bf45c284f8d7c29c, role.id=8e4aa52bcd2a47389ee1c5de44fa28ca, scope.project.id=f39fd5a3969c4e89ad6198892166ec4d) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:12.310455 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1f114-856d-4a4b-b7bc-9f8511c3ccdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:12.311885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1f114-856d-4a4b-b7bc-9f8511c3ccdc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:12.318114 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 220/435] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 23 16:12:12 2022] GET /identity/v3/role_assignments?group.id=d5ef3c66fa7a4994bf45c284f8d7c29c&scope.project.id=f39fd5a3969c4e89ad6198892166ec4d&role.id=8e4aa52bcd2a47389ee1c5de44fa28ca => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:12.318900 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1f114-856d-4a4b-b7bc-9f8511c3ccdc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:12.327897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 216/436] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:12.447007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1f114-856d-4a4b-b7bc-9f8511c3ccdc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:12.465293 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57925654-4b14-4620-a7d2-43b56acb7d5b None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:12.465598 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57925654-4b14-4620-a7d2-43b56acb7d5b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:12.465849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57925654-4b14-4620-a7d2-43b56acb7d5b None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:12.471804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 217/437] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:12:12.473648 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e733e79-4716-4dce-97e0-04ed52f7c62c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:12.473648 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e733e79-4716-4dce-97e0-04ed52f7c62c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:12.473648 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e733e79-4716-4dce-97e0-04ed52f7c62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:12.486585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82861246-0dc8-4052-aea6-ba2c4b292847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:12.487203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82861246-0dc8-4052-aea6-ba2c4b292847 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:12.488319 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82861246-0dc8-4052-aea6-ba2c4b292847 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:12.488319 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82861246-0dc8-4052-aea6-ba2c4b292847 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:12.488480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82861246-0dc8-4052-aea6-ba2c4b292847 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:12.488703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82861246-0dc8-4052-aea6-ba2c4b292847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:12.490099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82861246-0dc8-4052-aea6-ba2c4b292847 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:12.494970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-8e733e79-4716-4dce-97e0-04ed52f7c62c None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:12.496947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8e733e79-4716-4dce-97e0-04ed52f7c62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:12.500170 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 221/438] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:12:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:12.506961 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82861246-0dc8-4052-aea6-ba2c4b292847 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:12.528313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:12.595521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 218/439] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:12:12.614226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e733e79-4716-4dce-97e0-04ed52f7c62c None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:12.629668 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82861246-0dc8-4052-aea6-ba2c4b292847 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:12.674730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2802d-c92f-4e00-8777-7535637a3fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:12.676605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2802d-c92f-4e00-8777-7535637a3fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:12.676605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2802d-c92f-4e00-8777-7535637a3fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:12.676605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2802d-c92f-4e00-8777-7535637a3fe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:12.683800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:12.750517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e733e79-4716-4dce-97e0-04ed52f7c62c None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:12.768592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2802d-c92f-4e00-8777-7535637a3fe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:12.770271 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2802d-c92f-4e00-8777-7535637a3fe1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:12.787478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:12.792447 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51c787-d827-4f75-bbf0-eaa5143d217f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:12.793379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51c787-d827-4f75-bbf0-eaa5143d217f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:12.793888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51c787-d827-4f75-bbf0-eaa5143d217f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:12.794405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51c787-d827-4f75-bbf0-eaa5143d217f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:12.811266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51c787-d827-4f75-bbf0-eaa5143d217f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:12.815006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-0e51c787-d827-4f75-bbf0-eaa5143d217f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:12:12.815006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:12.815006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:12.815006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:12.815006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:12.815006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:12.815006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:12.815006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:12.815006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:12.815006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:12.815006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:12.815006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:12.815006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:12.815006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:12.815006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:12.815006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:12.816324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:12.816324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:12.816324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:12.816324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:12.816324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:12.816324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:12.816324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:12.816324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:12.816324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:12.816324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:12.816324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:12.816324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:12.816324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:12.816324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:12.816324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:12.816324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:12.817111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:12.817111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:12.817111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:12.817111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:12.817111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:12.817111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:12.817111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:12.817111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:12.817111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:12.817111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:12.817111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:12:12.817111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:12.817111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 219/440] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:12:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:12:12.822686 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51c787-d827-4f75-bbf0-eaa5143d217f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:12.906034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 222/441] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:12:12.909273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2802d-c92f-4e00-8777-7535637a3fe1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:12.962681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51c787-d827-4f75-bbf0-eaa5143d217f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:12.980129 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:13.005794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc7287-c462-436c-8e23-53283b9efcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:13.006362 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc7287-c462-436c-8e23-53283b9efcc1 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:13.006644 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc7287-c462-436c-8e23-53283b9efcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:13.006918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc7287-c462-436c-8e23-53283b9efcc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:13.007591 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc7287-c462-436c-8e23-53283b9efcc1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:13.007892 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc7287-c462-436c-8e23-53283b9efcc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:13.009274 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc7287-c462-436c-8e23-53283b9efcc1 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:13.018270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 220/442] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:13.019071 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc7287-c462-436c-8e23-53283b9efcc1 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:13.019744 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2802d-c92f-4e00-8777-7535637a3fe1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:13.037509 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:13.058286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b44116-f1af-4d70-be11-92bd94e3e5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:13.058908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b44116-f1af-4d70-be11-92bd94e3e5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:13.059217 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b44116-f1af-4d70-be11-92bd94e3e5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:13.059452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b44116-f1af-4d70-be11-92bd94e3e5f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:13.069214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b44116-f1af-4d70-be11-92bd94e3e5f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:13.074706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-86b44116-f1af-4d70-be11-92bd94e3e5f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:12:13.074706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:13.074706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:13.074706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:13.074706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:13.074706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:13.074706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:13.074706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:13.074706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:13.074706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:13.074706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:13.074706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:13.074706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:13.074706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:13.074706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:13.074706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:13.075617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:13.075617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:13.075617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:13.075617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:13.075617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:13.075617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:13.075617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:13.075617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:13.075617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:13.075617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:13.075617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:13.075617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:13.075617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:13.075617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:13.075617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:13.075617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:13.076407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:13.076407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:13.076407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:13.076407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:13.076407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:13.076407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:13.076407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:13.076407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:13.076407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:13.076407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:13.076407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:12:13.076407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:13.076407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 223/443] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:12:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:13.077062 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b44116-f1af-4d70-be11-92bd94e3e5f0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:13.123393 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc7287-c462-436c-8e23-53283b9efcc1 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:13.156524 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe8099-da16-4542-b26c-f073928d3a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:13.157145 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe8099-da16-4542-b26c-f073928d3a74 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:13.157425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe8099-da16-4542-b26c-f073928d3a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:13.157705 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe8099-da16-4542-b26c-f073928d3a74 None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:13.159121 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe8099-da16-4542-b26c-f073928d3a74 None admin] RBAC: Authorizing `identity:get_project(project_id=f02e08c335f848b3969fbf9251eecd90)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:13.160571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe8099-da16-4542-b26c-f073928d3a74 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:13.162240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 221/444] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:12:13 2022] GET /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:13.163017 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe8099-da16-4542-b26c-f073928d3a74 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:13.180309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b44116-f1af-4d70-be11-92bd94e3e5f0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:13.207249 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:13.214862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5fab2-9444-4567-b36c-602451bea6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:13.215469 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5fab2-9444-4567-b36c-602451bea6aa None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:13.215744 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5fab2-9444-4567-b36c-602451bea6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:13.216019 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5fab2-9444-4567-b36c-602451bea6aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:13.257150 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:13.264905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe8099-da16-4542-b26c-f073928d3a74 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:13.282683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5fab2-9444-4567-b36c-602451bea6aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:13.284412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5fab2-9444-4567-b36c-602451bea6aa None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:13.299019 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdb2d7-31aa-4f51-ad09-4720bf743d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:13.299621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdb2d7-31aa-4f51-ad09-4720bf743d4f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:13.299905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdb2d7-31aa-4f51-ad09-4720bf743d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:13.300185 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdb2d7-31aa-4f51-ad09-4720bf743d4f None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:13.300847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdb2d7-31aa-4f51-ad09-4720bf743d4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:13.301155 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdb2d7-31aa-4f51-ad09-4720bf743d4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:13.302546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdb2d7-31aa-4f51-ad09-4720bf743d4f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:13.310498 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 222/445] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:13.311286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdb2d7-31aa-4f51-ad09-4720bf743d4f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:13.382374 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 224/446] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:12:13.383319 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5fab2-9444-4567-b36c-602451bea6aa None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:13.419657 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdb2d7-31aa-4f51-ad09-4720bf743d4f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:13.421934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:13.453838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e1201-4ae9-419e-8453-a7852ca22cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:13.454493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e1201-4ae9-419e-8453-a7852ca22cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:13.454777 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e1201-4ae9-419e-8453-a7852ca22cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:13.455050 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e1201-4ae9-419e-8453-a7852ca22cc6 None admin] PATH_INFO: `/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:13.456162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e1201-4ae9-419e-8453-a7852ca22cc6 None admin] RBAC: Authorizing `identity:get_group(group_id=d5ef3c66fa7a4994bf45c284f8d7c29c)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:13.457603 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e1201-4ae9-419e-8453-a7852ca22cc6 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:13.457898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:13.459215 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 223/447] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 16:12:13 2022] GET /identity/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:13.460047 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e1201-4ae9-419e-8453-a7852ca22cc6 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:13.487640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5fab2-9444-4567-b36c-602451bea6aa None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:13.521820 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5f945-60a2-4b17-9bf5-960382c133ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:13.522372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5f945-60a2-4b17-9bf5-960382c133ae None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:13.522657 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5f945-60a2-4b17-9bf5-960382c133ae None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:13.522928 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5f945-60a2-4b17-9bf5-960382c133ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:13.561463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e1201-4ae9-419e-8453-a7852ca22cc6 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:13.591999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5f945-60a2-4b17-9bf5-960382c133ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:13.593470 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5f945-60a2-4b17-9bf5-960382c133ae None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:13.596907 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9339f93-f660-4b77-b7fc-86517eaae631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:13.597521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9339f93-f660-4b77-b7fc-86517eaae631 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:13.597800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9339f93-f660-4b77-b7fc-86517eaae631 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:13.598089 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9339f93-f660-4b77-b7fc-86517eaae631 None admin] PATH_INFO: `/v3/projects/f02e08c335f848b3969fbf9251eecd90` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:13.599208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9339f93-f660-4b77-b7fc-86517eaae631 None admin] RBAC: Authorizing `identity:get_project(project_id=f02e08c335f848b3969fbf9251eecd90)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:13.600623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9339f93-f660-4b77-b7fc-86517eaae631 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:13.602242 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 224/448] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:12:13 2022] GET /identity/v3/projects/f02e08c335f848b3969fbf9251eecd90 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:13.603000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9339f93-f660-4b77-b7fc-86517eaae631 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:13.644135 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:13.668466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:13.693810 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 225/449] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:12:13.694665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5f945-60a2-4b17-9bf5-960382c133ae None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:13.707480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9339f93-f660-4b77-b7fc-86517eaae631 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:13.742005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b4516-2cd3-4702-a970-1053d10ef6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:13.742636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b4516-2cd3-4702-a970-1053d10ef6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:13.742922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b4516-2cd3-4702-a970-1053d10ef6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:13.743194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b4516-2cd3-4702-a970-1053d10ef6e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:13.744588 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b4516-2cd3-4702-a970-1053d10ef6e0 None admin] RBAC: Adding query filter params (group.id=d5ef3c66fa7a4994bf45c284f8d7c29c, role.id=8e4aa52bcd2a47389ee1c5de44fa28ca, scope.project.id=f02e08c335f848b3969fbf9251eecd90) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:13.745145 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b4516-2cd3-4702-a970-1053d10ef6e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:13.747225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b4516-2cd3-4702-a970-1053d10ef6e0 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:13.752674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 225/450] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 23 16:12:13 2022] GET /identity/v3/role_assignments?group.id=d5ef3c66fa7a4994bf45c284f8d7c29c&scope.project.id=f02e08c335f848b3969fbf9251eecd90&role.id=8e4aa52bcd2a47389ee1c5de44fa28ca => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:13.753463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b4516-2cd3-4702-a970-1053d10ef6e0 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:13.812435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5f945-60a2-4b17-9bf5-960382c133ae None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:13.851273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e4b64-3b72-4c11-95bd-d828a80cd123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:13.851919 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e4b64-3b72-4c11-95bd-d828a80cd123 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:13.852205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e4b64-3b72-4c11-95bd-d828a80cd123 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:13.852475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e4b64-3b72-4c11-95bd-d828a80cd123 None admin] PATH_INFO: `/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:13.854780 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e4b64-3b72-4c11-95bd-d828a80cd123 None admin] RBAC: Authorizing `identity:get_group(group_id=d5ef3c66fa7a4994bf45c284f8d7c29c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:13.856252 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e4b64-3b72-4c11-95bd-d828a80cd123 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:13.857901 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 226/451] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 16:12:13 2022] GET /identity/v3/groups/d5ef3c66fa7a4994bf45c284f8d7c29c => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:13.863979 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e4b64-3b72-4c11-95bd-d828a80cd123 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:13.871421 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b4516-2cd3-4702-a970-1053d10ef6e0 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:13.874934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:13.917683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627109d2-4f2d-4b36-809b-1a5344cb9be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:13.920538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627109d2-4f2d-4b36-809b-1a5344cb9be2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:13.920661 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:13.921102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627109d2-4f2d-4b36-809b-1a5344cb9be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:13.921102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627109d2-4f2d-4b36-809b-1a5344cb9be2 None admin] PATH_INFO: `/v3/projects/062779fbe176490e8964d5f2d8d34b76` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:13.921102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627109d2-4f2d-4b36-809b-1a5344cb9be2 None admin] RBAC: Authorizing `identity:get_project(project_id=062779fbe176490e8964d5f2d8d34b76)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:13.922444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627109d2-4f2d-4b36-809b-1a5344cb9be2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:13.924390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 226/452] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:12:13 2022] GET /identity/v3/projects/062779fbe176490e8964d5f2d8d34b76 => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:13.929545 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627109d2-4f2d-4b36-809b-1a5344cb9be2 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:13.988900 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e4b64-3b72-4c11-95bd-d828a80cd123 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:14.024953 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc1f2a-0831-4462-af59-4b8b9bc431b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:14.026262 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc1f2a-0831-4462-af59-4b8b9bc431b7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:14.026593 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc1f2a-0831-4462-af59-4b8b9bc431b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:14.026872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc1f2a-0831-4462-af59-4b8b9bc431b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:14.027611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc1f2a-0831-4462-af59-4b8b9bc431b7 None admin] RBAC: Adding query filter params (group.id=d5ef3c66fa7a4994bf45c284f8d7c29c, role.id=41d658f3417e4e48b117d57120991ad8, scope.project.id=f02e08c335f848b3969fbf9251eecd90) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:14.027927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc1f2a-0831-4462-af59-4b8b9bc431b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:14.029372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc1f2a-0831-4462-af59-4b8b9bc431b7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:14.035927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 227/453] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 23 16:12:13 2022] GET /identity/v3/role_assignments?group.id=d5ef3c66fa7a4994bf45c284f8d7c29c&scope.project.id=f02e08c335f848b3969fbf9251eecd90&role.id=41d658f3417e4e48b117d57120991ad8 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:14.054496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627109d2-4f2d-4b36-809b-1a5344cb9be2 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:14.100861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243974b7-0e24-4bca-b0de-df1e4f20f5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:14.101879 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243974b7-0e24-4bca-b0de-df1e4f20f5da None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:14.102408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243974b7-0e24-4bca-b0de-df1e4f20f5da None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:14.102878 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243974b7-0e24-4bca-b0de-df1e4f20f5da None admin] PATH_INFO: `/v3/groups/0b19b213eeca46d4a0ea509d7e911038` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:14.105331 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243974b7-0e24-4bca-b0de-df1e4f20f5da None admin] RBAC: Authorizing `identity:get_group(group_id=0b19b213eeca46d4a0ea509d7e911038)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:14.107092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243974b7-0e24-4bca-b0de-df1e4f20f5da None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:14.108957 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 227/454] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 16:12:13 2022] GET /identity/v3/groups/0b19b213eeca46d4a0ea509d7e911038 => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:14.115116 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc1f2a-0831-4462-af59-4b8b9bc431b7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:14.226476 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc1f2a-0831-4462-af59-4b8b9bc431b7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:14.233523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:14.261010 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd422d5-91e5-4556-af9e-056c643ddcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:14.261609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd422d5-91e5-4556-af9e-056c643ddcf6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:14.261889 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd422d5-91e5-4556-af9e-056c643ddcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:14.262193 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd422d5-91e5-4556-af9e-056c643ddcf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:14.262915 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd422d5-91e5-4556-af9e-056c643ddcf6 None admin] RBAC: Adding query filter params (group.id=0b19b213eeca46d4a0ea509d7e911038, role.id=8de0c87242d7426ea25a510b578c02aa, scope.project.id=062779fbe176490e8964d5f2d8d34b76) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:14.263222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd422d5-91e5-4556-af9e-056c643ddcf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:14.264646 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd422d5-91e5-4556-af9e-056c643ddcf6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:14.270487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 228/455] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 23 16:12:14 2022] GET /identity/v3/role_assignments?group.id=0b19b213eeca46d4a0ea509d7e911038&scope.project.id=062779fbe176490e8964d5f2d8d34b76&role.id=8de0c87242d7426ea25a510b578c02aa => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:16.552037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5b3eb-bdb4-4d6d-a05d-d8eabb2d837a None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:16.552539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5b3eb-bdb4-4d6d-a05d-d8eabb2d837a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:16.552539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5b3eb-bdb4-4d6d-a05d-d8eabb2d837a None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:16.554119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 228/456] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:16.561046 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2869fa7-89ee-4a8d-9f48-6d7a77bf523d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:16.561956 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2869fa7-89ee-4a8d-9f48-6d7a77bf523d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:16.562527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2869fa7-89ee-4a8d-9f48-6d7a77bf523d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:16.583392 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b2869fa7-89ee-4a8d-9f48-6d7a77bf523d None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:16.584949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b2869fa7-89ee-4a8d-9f48-6d7a77bf523d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:16.665519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 229/457] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:16.718719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e69c1e-b4b7-48e8-be4b-fcce51552100 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:16.719354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e69c1e-b4b7-48e8-be4b-fcce51552100 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:16.719822 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e69c1e-b4b7-48e8-be4b-fcce51552100 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:16.721640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 229/458] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:16.727038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b22bc-6d1b-4c93-aec6-02ba32210d7d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:16.727578 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b22bc-6d1b-4c93-aec6-02ba32210d7d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:16.728728 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b22bc-6d1b-4c93-aec6-02ba32210d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:16.754331 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-cc2b22bc-6d1b-4c93-aec6-02ba32210d7d None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:16.755868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cc2b22bc-6d1b-4c93-aec6-02ba32210d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:16.855402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 230/459] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:16.972471 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e69c1e-b4b7-48e8-be4b-fcce51552100 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:17.027070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:17.107446 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e69c1e-b4b7-48e8-be4b-fcce51552100 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:17.159955 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0f29d-0eaf-4bc8-bb71-9940f67f8762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:17.160588 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0f29d-0eaf-4bc8-bb71-9940f67f8762 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:17.160872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0f29d-0eaf-4bc8-bb71-9940f67f8762 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:17.161196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0f29d-0eaf-4bc8-bb71-9940f67f8762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:17.163913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8deb88-feaa-4027-bb5a-e6f157d4f806 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:17.164409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8deb88-feaa-4027-bb5a-e6f157d4f806 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:17.164877 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8deb88-feaa-4027-bb5a-e6f157d4f806 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:17.166980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 231/460] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:17.172617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d2ff8-2f17-4185-a8fa-aa49d6eacff8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:17.173175 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d2ff8-2f17-4185-a8fa-aa49d6eacff8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:17.173641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d2ff8-2f17-4185-a8fa-aa49d6eacff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:17.185030 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0f29d-0eaf-4bc8-bb71-9940f67f8762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:17.186537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0f29d-0eaf-4bc8-bb71-9940f67f8762 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:17.208574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-23e0f29d-0eaf-4bc8-bb71-9940f67f8762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:17.208574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:17.208574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:17.208574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:17.208574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:17.208574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:17.208574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:17.208574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:17.208574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:17.208574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:17.208574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:17.208574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:17.208574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:17.208574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:17.208574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:17.208574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:17.209538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:17.209538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:17.209538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:17.209538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:17.209538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:17.209538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:17.209538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:17.209538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:17.209538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:17.209538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:17.209538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:17.209538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:17.209538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:17.209538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:17.209538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:17.209538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:17.209538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:17.210432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:17.210432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:17.210432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:17.210432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 230/461] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:17.213629 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-342d2ff8-2f17-4185-a8fa-aa49d6eacff8 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:17.215122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-342d2ff8-2f17-4185-a8fa-aa49d6eacff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:17.218317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0f29d-0eaf-4bc8-bb71-9940f67f8762 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:17.263819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:17.339949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 232/462] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:12:17.340964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d2ff8-2f17-4185-a8fa-aa49d6eacff8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:17.399832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:17.417354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0f29d-0eaf-4bc8-bb71-9940f67f8762 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:17.487319 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d1b0f-5f16-4364-8ff6-c6d5c96091f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:17.487932 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d1b0f-5f16-4364-8ff6-c6d5c96091f5 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:17.488217 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d1b0f-5f16-4364-8ff6-c6d5c96091f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:17.488493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d1b0f-5f16-4364-8ff6-c6d5c96091f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:17.489141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d1b0f-5f16-4364-8ff6-c6d5c96091f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:17.489446 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d1b0f-5f16-4364-8ff6-c6d5c96091f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:17.490845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d1b0f-5f16-4364-8ff6-c6d5c96091f5 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:17.514011 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 231/463] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:17.515324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9a33f-c75c-43e8-b30a-7a6387fe641f None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:17.515603 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9a33f-c75c-43e8-b30a-7a6387fe641f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:17.515882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9a33f-c75c-43e8-b30a-7a6387fe641f None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:17.517059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 232/464] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:17.523031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9a33f-c75c-43e8-b30a-7a6387fe641f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:17.535090 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d2ff8-2f17-4185-a8fa-aa49d6eacff8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:17.579864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fab305-a0e7-4e64-9f29-92da853d8659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:17.580505 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fab305-a0e7-4e64-9f29-92da853d8659 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:17.580829 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fab305-a0e7-4e64-9f29-92da853d8659 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:17.581189 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fab305-a0e7-4e64-9f29-92da853d8659 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:17.596054 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fab305-a0e7-4e64-9f29-92da853d8659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:17.597576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fab305-a0e7-4e64-9f29-92da853d8659 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:17.612798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-26fab305-a0e7-4e64-9f29-92da853d8659 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:17.612798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:17.612798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:17.612798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:17.612798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:17.612798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:17.612798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:17.612798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:17.612798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:17.612798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:17.612798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:17.612798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:17.612798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:17.612798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:17.612798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:17.612798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:17.613891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:17.613891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:17.613891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:17.613891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:17.613891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:17.613891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:17.613891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:17.613891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:17.613891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:17.613891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:17.613891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:17.613891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:17.613891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:17.613891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:17.613891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:17.613891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:17.613891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:17.614980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:17.614980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:17.614980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:17.614980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 233/465] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:17.615568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44647bed-9498-44b8-aff0-f149b5f75a3d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:17.617174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44647bed-9498-44b8-aff0-f149b5f75a3d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:17.617174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44647bed-9498-44b8-aff0-f149b5f75a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:17.634180 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-44647bed-9498-44b8-aff0-f149b5f75a3d None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:17.635918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-44647bed-9498-44b8-aff0-f149b5f75a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:17.644149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:17.657674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9a33f-c75c-43e8-b30a-7a6387fe641f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:17.702723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2bf7ba-c12d-4e81-8302-98f3a1cb37b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:17.703328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bf7ba-c12d-4e81-8302-98f3a1cb37b6 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:17.703712 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bf7ba-c12d-4e81-8302-98f3a1cb37b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:17.704004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bf7ba-c12d-4e81-8302-98f3a1cb37b6 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:17.704521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2bf7ba-c12d-4e81-8302-98f3a1cb37b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:17.705978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2bf7ba-c12d-4e81-8302-98f3a1cb37b6 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:17.710532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 234/466] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:17.711387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44647bed-9498-44b8-aff0-f149b5f75a3d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:17.744819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 233/467] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 16:12:17 2022] POST /identity/v3/users => generated 246 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:12:17.744819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2bf7ba-c12d-4e81-8302-98f3a1cb37b6 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:17.777154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:17.889399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44647bed-9498-44b8-aff0-f149b5f75a3d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:17.956501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c3f3d-c6ce-40ee-becb-bee03ed272a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:17.957033 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c3f3d-c6ce-40ee-becb-bee03ed272a0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:17.957313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c3f3d-c6ce-40ee-becb-bee03ed272a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:17.957582 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c3f3d-c6ce-40ee-becb-bee03ed272a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:17.958269 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c3f3d-c6ce-40ee-becb-bee03ed272a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:17.958624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c3f3d-c6ce-40ee-becb-bee03ed272a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:17.960040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c3f3d-c6ce-40ee-becb-bee03ed272a0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:17.961587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2bf7ba-c12d-4e81-8302-98f3a1cb37b6 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:17.978189 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 235/468] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:17.979767 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c3f3d-c6ce-40ee-becb-bee03ed272a0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:17.988703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:18.016193 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be263e-9989-4df3-b723-4b9e5cedb183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:18.017010 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be263e-9989-4df3-b723-4b9e5cedb183 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:18.017272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be263e-9989-4df3-b723-4b9e5cedb183 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:18.017871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be263e-9989-4df3-b723-4b9e5cedb183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:18.031419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be263e-9989-4df3-b723-4b9e5cedb183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:18.032892 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be263e-9989-4df3-b723-4b9e5cedb183 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:18.054238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-80be263e-9989-4df3-b723-4b9e5cedb183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:18.054238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:18.054238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:18.054238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:18.054238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:18.054238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:18.054238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:18.054238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:18.054238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:18.054238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:18.054238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:18.054238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:18.054238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:18.054238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:18.054238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:18.054238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:18.055199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:18.055199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:18.055199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:18.055199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:18.055199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:18.055199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:18.055199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:18.055199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:18.055199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:18.055199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:18.055199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:18.055199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:18.055199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:18.055199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:18.055199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:18.055199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:18.055199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:18.056062 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:18.056062 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:18.056062 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:18.056062 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 234/469] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:18.056861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be263e-9989-4df3-b723-4b9e5cedb183 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:18.123789 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c3f3d-c6ce-40ee-becb-bee03ed272a0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:18.125952 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:18.169417 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be263e-9989-4df3-b723-4b9e5cedb183 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:18.173864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e38804-7b87-4a5d-9761-4bdf4c205577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:18.174776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e38804-7b87-4a5d-9761-4bdf4c205577 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:18.175217 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e38804-7b87-4a5d-9761-4bdf4c205577 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:18.175651 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e38804-7b87-4a5d-9761-4bdf4c205577 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:18.176439 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e38804-7b87-4a5d-9761-4bdf4c205577 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:18.178460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e38804-7b87-4a5d-9761-4bdf4c205577 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:18.205306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9014d-0252-47e4-8947-d09787f40b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:18.205983 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9014d-0252-47e4-8947-d09787f40b18 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:18.206331 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9014d-0252-47e4-8947-d09787f40b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:18.206701 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9014d-0252-47e4-8947-d09787f40b18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:18.207949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 236/470] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 16:12:17 2022] POST /identity/v3/users => generated 248 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:12:18.209058 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e38804-7b87-4a5d-9761-4bdf4c205577 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:18.235290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9014d-0252-47e4-8947-d09787f40b18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:18.236788 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9014d-0252-47e4-8947-d09787f40b18 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:18.266243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-40f9014d-0252-47e4-8947-d09787f40b18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:18.266243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:18.266243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:18.266243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:18.266243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:18.266243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:18.266243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:18.266243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:18.266243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:18.266243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:18.266243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:18.266243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:18.266243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:18.266243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:18.266243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:18.266243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:18.267408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:18.267408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:18.267408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:18.267408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:18.267408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:18.267408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:18.267408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:18.267408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:18.267408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:18.267408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:18.267408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:18.267408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:18.267408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:18.267408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:18.267408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:18.267408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:18.267408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:18.273318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:18.273318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:18.273318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:18.273318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 235/471] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:18.283828 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435de22a-27d2-4d4a-b9c3-f99be2136b05 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:18.284105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435de22a-27d2-4d4a-b9c3-f99be2136b05 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:18.284382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435de22a-27d2-4d4a-b9c3-f99be2136b05 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:18.286088 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 236/472] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:18.286906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435de22a-27d2-4d4a-b9c3-f99be2136b05 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:18.297709 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:18.369432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e38804-7b87-4a5d-9761-4bdf4c205577 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:18.413428 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d526110-59cd-4355-b6bc-dc7ae9e23982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:18.414369 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d526110-59cd-4355-b6bc-dc7ae9e23982 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:18.414853 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d526110-59cd-4355-b6bc-dc7ae9e23982 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:18.415271 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d526110-59cd-4355-b6bc-dc7ae9e23982 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:18.417344 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d526110-59cd-4355-b6bc-dc7ae9e23982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:18.417807 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d526110-59cd-4355-b6bc-dc7ae9e23982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:18.419574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d526110-59cd-4355-b6bc-dc7ae9e23982 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:18.424104 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435de22a-27d2-4d4a-b9c3-f99be2136b05 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:18.434623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 237/473] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:18.436917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e54af-fd05-43f2-a828-e31ab103d14f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:18.437359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e54af-fd05-43f2-a828-e31ab103d14f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:18.437636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e54af-fd05-43f2-a828-e31ab103d14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:18.443224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:18.456786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ec0e54af-fd05-43f2-a828-e31ab103d14f None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:18.458016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ec0e54af-fd05-43f2-a828-e31ab103d14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:18.468330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e17599-c458-48e4-9fe2-a9cb9944e782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:18.469657 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e17599-c458-48e4-9fe2-a9cb9944e782 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:18.469950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e17599-c458-48e4-9fe2-a9cb9944e782 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:18.470297 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e17599-c458-48e4-9fe2-a9cb9944e782 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:18.471295 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e17599-c458-48e4-9fe2-a9cb9944e782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:18.471619 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e17599-c458-48e4-9fe2-a9cb9944e782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:18.473014 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e17599-c458-48e4-9fe2-a9cb9944e782 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:18.488177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 237/474] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:18.489025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e17599-c458-48e4-9fe2-a9cb9944e782 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:18.545035 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 238/475] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:18.545869 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e54af-fd05-43f2-a828-e31ab103d14f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:18.609877 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e17599-c458-48e4-9fe2-a9cb9944e782 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:18.631758 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:18.648090 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dd495-0329-4f87-9160-cc5e6f1ae1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:18.648697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dd495-0329-4f87-9160-cc5e6f1ae1f2 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:18.648979 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dd495-0329-4f87-9160-cc5e6f1ae1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:18.649252 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dd495-0329-4f87-9160-cc5e6f1ae1f2 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:18.650014 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3dd495-0329-4f87-9160-cc5e6f1ae1f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:18.651481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3dd495-0329-4f87-9160-cc5e6f1ae1f2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:18.683513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 238/476] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 16:12:18 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:12:18.710906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e54af-fd05-43f2-a828-e31ab103d14f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:18.769387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731f28b-4eeb-4bc4-b552-894e760dbad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:18.770100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731f28b-4eeb-4bc4-b552-894e760dbad6 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:18.770429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731f28b-4eeb-4bc4-b552-894e760dbad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:18.770770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731f28b-4eeb-4bc4-b552-894e760dbad6 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:18.771499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731f28b-4eeb-4bc4-b552-894e760dbad6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:18.773102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731f28b-4eeb-4bc4-b552-894e760dbad6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:18.799558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 239/477] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 16:12:18 2022] POST /identity/v3/users => generated 249 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:12:18.908911 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dd495-0329-4f87-9160-cc5e6f1ae1f2 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:18.944140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:19.029536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dd495-0329-4f87-9160-cc5e6f1ae1f2 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:19.067600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b501441-4a62-48ab-803e-686105833908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:19.068219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b501441-4a62-48ab-803e-686105833908 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:19.068502 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b501441-4a62-48ab-803e-686105833908 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:19.068782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b501441-4a62-48ab-803e-686105833908 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:19.069463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b501441-4a62-48ab-803e-686105833908 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:19.070934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b501441-4a62-48ab-803e-686105833908 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:19.079650 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.sql.core [None req-8b501441-4a62-48ab-803e-686105833908 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 16:12:19.079650 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 23 16:12:19.079650 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [parameters: {'id': '1dff1ad76d0d477cb41fbc371502bad6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 23 16:12:19.079650 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81604) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 16:12:19.095750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-8b501441-4a62-48ab-803e-686105833908 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 23 16:12:19.095750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:19.095750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 16:12:19.095750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 16:12:19.095750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 16:12:19.095750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 16:12:19.095750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 16:12:19.095750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 16:12:19.095750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 16:12:19.095750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application conn.query(q) Aug 23 16:12:19.095750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 16:12:19.095750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 16:12:19.095750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 16:12:19.095750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application result.read() Aug 23 16:12:19.095750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 16:12:19.096687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 16:12:19.096687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 16:12:19.096687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 16:12:19.096687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 16:12:19.096687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 16:12:19.096687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 16:12:19.096687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 16:12:19.096687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 16:12:19.096687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:19.096687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 16:12:19.096687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:19.096687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:19.096687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 16:12:19.096687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 16:12:19.096687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 23 16:12:19.096687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return ref.to_dict() Aug 23 16:12:19.096687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 16:12:19.096687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application next(self.gen) Aug 23 16:12:19.097664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 16:12:19.097664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application yield resource Aug 23 16:12:19.097664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 16:12:19.097664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application next(self.gen) Aug 23 16:12:19.097664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 16:12:19.097664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 16:12:19.097664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 16:12:19.097664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 16:12:19.097664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 16:12:19.097664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise self.value Aug 23 16:12:19.097664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 16:12:19.097664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 16:12:19.097664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 16:12:19.097664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application session.commit() Aug 23 16:12:19.097664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 16:12:19.097664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 16:12:19.097664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 16:12:19.098558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 16:12:19.098558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 16:12:19.098558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self.session.flush() Aug 23 16:12:19.098558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 16:12:19.098558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 16:12:19.098558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 16:12:19.098558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 16:12:19.098558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 16:12:19.098558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application compat.raise_( Aug 23 16:12:19.098558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 16:12:19.098558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception Aug 23 16:12:19.098558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 16:12:19.098558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 16:12:19.098558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 16:12:19.098558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 16:12:19.098558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 16:12:19.098558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 16:12:19.099427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 16:12:19.099427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 16:12:19.099427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 16:12:19.099427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 16:12:19.099427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 16:12:19.099427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 16:12:19.099427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 16:12:19.099427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 16:12:19.099427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 16:12:19.099427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 16:12:19.099427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 16:12:19.099427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 16:12:19.099427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 16:12:19.099427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 16:12:19.099427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 16:12:19.099427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception Aug 23 16:12:19.100238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 16:12:19.100238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 16:12:19.100238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 16:12:19.100238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 16:12:19.100238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 16:12:19.100238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 16:12:19.100238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 16:12:19.100238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application conn.query(q) Aug 23 16:12:19.100238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 16:12:19.100238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 16:12:19.100238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 16:12:19.100238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application result.read() Aug 23 16:12:19.100238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 16:12:19.100238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 16:12:19.100238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 16:12:19.100238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 16:12:19.101001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 16:12:19.101001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 16:12:19.101001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 16:12:19.101001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 16:12:19.101001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 16:12:19.101001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 23 16:12:19.101001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [parameters: {'id': '1dff1ad76d0d477cb41fbc371502bad6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 23 16:12:19.101001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 16:12:19.101001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:19.101001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:12:19.101001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:19.101001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:19.101001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:19.101001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:19.101001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:19.101001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:19.101799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:19.101799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:19.101799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:19.101799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:19.101799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:19.101799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:19.101799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 23 16:12:19.101799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 23 16:12:19.101799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:19.101799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:19.101799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 23 16:12:19.101799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 23 16:12:19.101799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 16:12:19.101799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 16:12:19.101799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 23 16:12:19.101799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:19.105325 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 239/478] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Aug 23 16:12:18 2022] POST /identity/v3/roles => generated 144 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:19.105561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731f28b-4eeb-4bc4-b552-894e760dbad6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:19.225101 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731f28b-4eeb-4bc4-b552-894e760dbad6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:19.229214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:19.266267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5416cbf-43dd-493a-bce1-f987e51f557b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:19.266907 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5416cbf-43dd-493a-bce1-f987e51f557b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:19.267193 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5416cbf-43dd-493a-bce1-f987e51f557b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:19.267469 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5416cbf-43dd-493a-bce1-f987e51f557b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:19.278724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5416cbf-43dd-493a-bce1-f987e51f557b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:19.284348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b5416cbf-43dd-493a-bce1-f987e51f557b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:12:19.284348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:19.284348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:19.284348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:19.284348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:19.284348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:19.284348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:19.284348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:19.284348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:19.284348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:19.284348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:19.284348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:19.284348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:19.284348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:19.284348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:19.284348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:19.285209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:19.285209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:19.285209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:19.285209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:19.285209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:19.285209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:19.285209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:19.285209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:19.285209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:19.285209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:19.285209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:19.285209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:19.285209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:19.285209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:19.285209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:19.285209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:19.286281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:19.286281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:19.286281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:19.286281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:19.286281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:19.286281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:19.286281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:19.286281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:19.286281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:19.286281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:19.286281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 16:12:19.286281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:19.286281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 240/479] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:12:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:19.291745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b501441-4a62-48ab-803e-686105833908 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:19.394729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:19.406963 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b501441-4a62-48ab-803e-686105833908 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:19.446754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ac109-41b8-4761-af99-60c6fc705239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:19.448238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ac109-41b8-4761-af99-60c6fc705239 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:19.448523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ac109-41b8-4761-af99-60c6fc705239 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:19.448795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ac109-41b8-4761-af99-60c6fc705239 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:19.449510 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ac109-41b8-4761-af99-60c6fc705239 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:19.450059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ac109-41b8-4761-af99-60c6fc705239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:19.451618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ac109-41b8-4761-af99-60c6fc705239 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:19.462293 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 240/480] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:20.139699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1c1fa-ee00-4408-98dc-7acd806740d3 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:20.140357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1c1fa-ee00-4408-98dc-7acd806740d3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:20.140357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1c1fa-ee00-4408-98dc-7acd806740d3 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:20.141825 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 241/481] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:20.147661 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3ac63-b752-4439-96fc-b5174cb8dfb9 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:20.148188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3ac63-b752-4439-96fc-b5174cb8dfb9 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:20.148188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3ac63-b752-4439-96fc-b5174cb8dfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:20.183178 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-c6b3ac63-b752-4439-96fc-b5174cb8dfb9 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:20.184409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c6b3ac63-b752-4439-96fc-b5174cb8dfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:20.264631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 241/482] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:20.422387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036e5e0-5c14-4e5d-9cb5-d8c16e83b501 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:20.422723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036e5e0-5c14-4e5d-9cb5-d8c16e83b501 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:20.422890 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036e5e0-5c14-4e5d-9cb5-d8c16e83b501 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:20.424435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 242/483] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:20.440240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f0ec4-b5d8-4b99-9333-ed7f24c1624b None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:20.440868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f0ec4-b5d8-4b99-9333-ed7f24c1624b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:20.441336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f0ec4-b5d8-4b99-9333-ed7f24c1624b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:20.470275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-202f0ec4-b5d8-4b99-9333-ed7f24c1624b None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:20.471796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-202f0ec4-b5d8-4b99-9333-ed7f24c1624b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:20.549745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 242/484] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:20.628603 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036e5e0-5c14-4e5d-9cb5-d8c16e83b501 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:20.734503 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036e5e0-5c14-4e5d-9cb5-d8c16e83b501 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:20.769744 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200ce60-03f4-402e-a37c-a177a513c461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:20.770413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200ce60-03f4-402e-a37c-a177a513c461 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:20.770697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200ce60-03f4-402e-a37c-a177a513c461 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:20.770971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200ce60-03f4-402e-a37c-a177a513c461 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:20.782132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200ce60-03f4-402e-a37c-a177a513c461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:20.787483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-3200ce60-03f4-402e-a37c-a177a513c461 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:20.787483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:20.787483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:20.787483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:20.787483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:20.787483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:20.787483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:20.787483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:20.787483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:20.787483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:20.787483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:20.787483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:20.787483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:20.787483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:20.787483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:20.787483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:20.788368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:20.788368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:20.788368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:20.788368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:20.788368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:20.788368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:20.788368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:20.788368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:20.788368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:20.788368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:20.788368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:20.788368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:20.788368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:20.788368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:20.788368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:20.788368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:20.789546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:20.789546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:20.789546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:20.789546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:20.789546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:20.789546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:20.789546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:20.789546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:20.789546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:20.789546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:20.789546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:20.789546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:20.789546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 243/485] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:20.794854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f0ec4-b5d8-4b99-9333-ed7f24c1624b None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:20.813682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:20.940325 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f0ec4-b5d8-4b99-9333-ed7f24c1624b None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:20.961148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200ce60-03f4-402e-a37c-a177a513c461 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:20.989644 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:20.989914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2ef44-96b2-484a-863c-d8a6225995b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:20.991290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2ef44-96b2-484a-863c-d8a6225995b3 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:20.991571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2ef44-96b2-484a-863c-d8a6225995b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:20.991847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2ef44-96b2-484a-863c-d8a6225995b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:20.992530 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2ef44-96b2-484a-863c-d8a6225995b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:20.992928 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2ef44-96b2-484a-863c-d8a6225995b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:20.995182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2ef44-96b2-484a-863c-d8a6225995b3 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:21.013400 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 243/486] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:21.020122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2ef44-96b2-484a-863c-d8a6225995b3 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:21.107760 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200ce60-03f4-402e-a37c-a177a513c461 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:21.145153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ed1b5-a9c2-4fec-9221-5becd6a4c6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:21.146706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ed1b5-a9c2-4fec-9221-5becd6a4c6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:21.147211 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ed1b5-a9c2-4fec-9221-5becd6a4c6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:21.147783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ed1b5-a9c2-4fec-9221-5becd6a4c6d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:21.160077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ed1b5-a9c2-4fec-9221-5becd6a4c6d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:21.166614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-7b6ed1b5-a9c2-4fec-9221-5becd6a4c6d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:21.166614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:21.166614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:21.166614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:21.166614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:21.166614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:21.166614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:21.166614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:21.166614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:21.166614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:21.166614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:21.166614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:21.166614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:21.166614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:21.166614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:21.166614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:21.167542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:21.167542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:21.167542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:21.167542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:21.167542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:21.167542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:21.167542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:21.167542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:21.167542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:21.167542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:21.167542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:21.167542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:21.167542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:21.167542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:21.167542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:21.167542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:21.168330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:21.168330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:21.168330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:21.168330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:21.168330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:21.168330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:21.168330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:21.168330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:21.168330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:21.168330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:21.168330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:21.168330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:21.171070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 244/487] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:12:21.184447 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:21.189710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ed1b5-a9c2-4fec-9221-5becd6a4c6d6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:21.215653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2ef44-96b2-484a-863c-d8a6225995b3 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:21.251743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb0039-f088-4a0f-b0d6-9784a0f0bfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:21.252322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb0039-f088-4a0f-b0d6-9784a0f0bfea None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:21.252601 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb0039-f088-4a0f-b0d6-9784a0f0bfea None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:21.252874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb0039-f088-4a0f-b0d6-9784a0f0bfea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:21.264747 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb0039-f088-4a0f-b0d6-9784a0f0bfea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:21.266253 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb0039-f088-4a0f-b0d6-9784a0f0bfea None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:21.281751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-bbbb0039-f088-4a0f-b0d6-9784a0f0bfea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:21.281751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:21.281751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:21.281751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:21.281751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:21.281751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:21.281751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:21.281751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:21.281751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:21.281751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:21.281751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:21.281751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:21.281751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:21.281751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:21.281751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:21.281751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:21.282872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:21.282872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:21.282872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:21.282872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:21.282872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:21.282872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:21.282872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:21.282872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:21.282872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:21.282872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:21.282872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:21.282872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:21.282872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:21.282872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:21.282872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:21.282872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:21.282872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:21.284005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:21.284005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:21.284005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:21.284005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 244/488] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:12:21.284217 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428a5ca-c702-45d2-993a-c3ffdebe6a96 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:21.284431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428a5ca-c702-45d2-993a-c3ffdebe6a96 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:21.284672 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428a5ca-c702-45d2-993a-c3ffdebe6a96 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:21.290112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 245/489] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:21.290112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428a5ca-c702-45d2-993a-c3ffdebe6a96 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:21.307063 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:21.328814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ed1b5-a9c2-4fec-9221-5becd6a4c6d6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:21.378442 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df66a51-68d2-4b3a-b974-ed35c784940d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:21.379463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df66a51-68d2-4b3a-b974-ed35c784940d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:21.379942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df66a51-68d2-4b3a-b974-ed35c784940d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:21.380412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df66a51-68d2-4b3a-b974-ed35c784940d None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:21.381276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df66a51-68d2-4b3a-b974-ed35c784940d None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:21.381774 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df66a51-68d2-4b3a-b974-ed35c784940d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:21.383388 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df66a51-68d2-4b3a-b974-ed35c784940d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:21.398096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 245/490] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:21.399724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86555d-a7ff-4994-ae92-1bc4b8afcb05 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:21.400277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86555d-a7ff-4994-ae92-1bc4b8afcb05 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:21.400774 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86555d-a7ff-4994-ae92-1bc4b8afcb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:21.417807 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428a5ca-c702-45d2-993a-c3ffdebe6a96 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:21.420448 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9a86555d-a7ff-4994-ae92-1bc4b8afcb05 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:21.421844 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9a86555d-a7ff-4994-ae92-1bc4b8afcb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:21.452036 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:21.461051 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c60a2-ca4d-4c37-a4ea-a816a5b143bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:21.461654 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c60a2-ca4d-4c37-a4ea-a816a5b143bb None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:21.461932 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c60a2-ca4d-4c37-a4ea-a816a5b143bb None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:21.462233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c60a2-ca4d-4c37-a4ea-a816a5b143bb None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:21.463696 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c60a2-ca4d-4c37-a4ea-a816a5b143bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:21.464000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c60a2-ca4d-4c37-a4ea-a816a5b143bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:21.466320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c60a2-ca4d-4c37-a4ea-a816a5b143bb None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:21.483391 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 246/491] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:21.484328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c60a2-ca4d-4c37-a4ea-a816a5b143bb None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:21.510233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 246/492] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:21.511441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86555d-a7ff-4994-ae92-1bc4b8afcb05 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:21.632682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c60a2-ca4d-4c37-a4ea-a816a5b143bb None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:21.637966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:21.670358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86555d-a7ff-4994-ae92-1bc4b8afcb05 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:21.672503 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d73cd4-6d80-462c-b088-17c988f13b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:21.673402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d73cd4-6d80-462c-b088-17c988f13b7f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:21.673877 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d73cd4-6d80-462c-b088-17c988f13b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:21.674398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d73cd4-6d80-462c-b088-17c988f13b7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:21.686094 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d73cd4-6d80-462c-b088-17c988f13b7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:21.688008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d73cd4-6d80-462c-b088-17c988f13b7f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:21.704802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-69d73cd4-6d80-462c-b088-17c988f13b7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:21.704802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:21.704802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:21.704802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:21.704802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:21.704802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:21.704802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:21.704802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:21.704802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:21.704802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:21.704802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:21.704802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:21.704802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:21.704802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:21.704802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:21.704802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:21.705793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:21.705793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:21.705793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:21.705793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:21.705793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:21.705793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:21.705793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:21.705793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:21.705793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:21.705793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:21.705793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:21.705793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:21.705793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:21.705793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:21.705793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:21.705793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:21.705793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:21.706671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:21.706671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:21.706671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:21.708512 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 247/493] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:21.709781 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343289a7-6484-4f1b-a552-afa1ac716eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:21.710427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4affb-d5d1-4cf7-a79f-32575d4178e9 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:21.710533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343289a7-6484-4f1b-a552-afa1ac716eaf None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:21.710730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343289a7-6484-4f1b-a552-afa1ac716eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:21.710982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343289a7-6484-4f1b-a552-afa1ac716eaf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:21.711402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4affb-d5d1-4cf7-a79f-32575d4178e9 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:21.711860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4affb-d5d1-4cf7-a79f-32575d4178e9 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:21.714032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 248/494] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:21.719512 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5cc47-1c44-49e5-b659-baaabe37bf3f None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:21.720041 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5cc47-1c44-49e5-b659-baaabe37bf3f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:21.720505 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5cc47-1c44-49e5-b659-baaabe37bf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:21.724537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343289a7-6484-4f1b-a552-afa1ac716eaf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:21.726110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343289a7-6484-4f1b-a552-afa1ac716eaf None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:21.741616 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-85a5cc47-1c44-49e5-b659-baaabe37bf3f None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:21.741815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-343289a7-6484-4f1b-a552-afa1ac716eaf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:12:21.741815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:21.741815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:21.741815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:21.741815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:21.741815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:21.741815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:21.741815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:21.741815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:21.741815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:21.741815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:21.741815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:21.741815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:21.741815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:21.741815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:21.741815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:21.742682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:21.742682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:21.742682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:21.742682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:21.742682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:21.742682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:21.742682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:21.742682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:21.742682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:21.742682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:21.742682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:21.742682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:21.742682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:21.742682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:21.742682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:21.742682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:21.742682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:21.742682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:21.744786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:21.744786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:21.744786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:21.744786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:21.744786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:21.744786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:21.744786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:21.744786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:21.744786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:12:21.744786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:21.744786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 247/495] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 23 16:12:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:21.744786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343289a7-6484-4f1b-a552-afa1ac716eaf None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:21.746983 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-85a5cc47-1c44-49e5-b659-baaabe37bf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:21.795285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:21.834025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 249/496] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:21.839523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5cc47-1c44-49e5-b659-baaabe37bf3f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:21.864957 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343289a7-6484-4f1b-a552-afa1ac716eaf None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:21.902754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ed9b0-29d1-45fa-8d47-d76f43500b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:21.903358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ed9b0-29d1-45fa-8d47-d76f43500b14 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:21.903637 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ed9b0-29d1-45fa-8d47-d76f43500b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:21.903957 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ed9b0-29d1-45fa-8d47-d76f43500b14 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:21.904604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ed9b0-29d1-45fa-8d47-d76f43500b14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:21.905201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ed9b0-29d1-45fa-8d47-d76f43500b14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:21.906364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ed9b0-29d1-45fa-8d47-d76f43500b14 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:21.909000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:21.921744 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 248/497] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:21.922405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ed9b0-29d1-45fa-8d47-d76f43500b14 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:21.966708 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5cc47-1c44-49e5-b659-baaabe37bf3f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:22.003523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43044f54-f82c-4236-bce4-f0fb70167ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:22.004494 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43044f54-f82c-4236-bce4-f0fb70167ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:22.005001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43044f54-f82c-4236-bce4-f0fb70167ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:22.005480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43044f54-f82c-4236-bce4-f0fb70167ee7 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:22.006456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43044f54-f82c-4236-bce4-f0fb70167ee7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:22.006959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43044f54-f82c-4236-bce4-f0fb70167ee7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:22.008597 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43044f54-f82c-4236-bce4-f0fb70167ee7 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:22.028824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ed9b0-29d1-45fa-8d47-d76f43500b14 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:22.048458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 250/498] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 23 16:12:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:22.049796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43044f54-f82c-4236-bce4-f0fb70167ee7 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:22.065872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c0fba-b54d-4f04-b4fa-70ac78a20062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:22.066487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c0fba-b54d-4f04-b4fa-70ac78a20062 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:22.066764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c0fba-b54d-4f04-b4fa-70ac78a20062 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:22.067032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c0fba-b54d-4f04-b4fa-70ac78a20062 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:22.078437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c0fba-b54d-4f04-b4fa-70ac78a20062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:22.081635 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:22.082967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-691c0fba-b54d-4f04-b4fa-70ac78a20062 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:22.082967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:22.082967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:22.082967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:22.082967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:22.082967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:22.082967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:22.082967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:22.082967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:22.082967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:22.082967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:22.082967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:22.082967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:22.082967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:22.082967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:22.082967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:22.083849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:22.083849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:22.083849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:22.083849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:22.083849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:22.083849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:22.083849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:22.083849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:22.083849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:22.083849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:22.083849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:22.083849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:22.083849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:22.083849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:22.083849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:22.083849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:22.084631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:22.084631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:22.084631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:22.084631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:22.084631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:22.084631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:22.084631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:22.084631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:22.084631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:22.084631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:22.084631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:22.084631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:22.089752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 249/499] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:22.090660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c0fba-b54d-4f04-b4fa-70ac78a20062 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:22.151838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:22.165342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43044f54-f82c-4236-bce4-f0fb70167ee7 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:22.208101 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fc533-7de2-44f2-9dd3-b29a94ab4da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:22.208762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fc533-7de2-44f2-9dd3-b29a94ab4da1 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:22.209005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fc533-7de2-44f2-9dd3-b29a94ab4da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:22.209277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9fc533-7de2-44f2-9dd3-b29a94ab4da1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:22.209719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c0fba-b54d-4f04-b4fa-70ac78a20062 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:22.218248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fc533-7de2-44f2-9dd3-b29a94ab4da1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:22.219671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9fc533-7de2-44f2-9dd3-b29a94ab4da1 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:22.235999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-5c9fc533-7de2-44f2-9dd3-b29a94ab4da1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:12:22.235999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:22.235999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:22.235999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:22.235999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:22.235999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:22.235999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:22.235999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:22.235999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:22.235999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:22.235999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:22.235999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:22.235999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:22.235999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:22.235999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:22.235999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:22.237106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:22.237106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:22.237106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:22.237106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:22.237106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:22.237106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:22.237106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:22.237106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:22.237106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:22.237106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:22.237106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:22.237106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:22.237106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:22.237106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:22.237106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:22.237106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:22.237106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:22.237106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:22.238009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:22.238009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:22.238009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:22.238009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:22.238009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:22.238009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:22.238009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:22.238009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:22.238009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:12:22.238009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:22.238009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 251/500] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:22.238623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fc533-7de2-44f2-9dd3-b29a94ab4da1 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:22.253188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85917d-86a0-4189-aad2-56715cc97163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:22.253806 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85917d-86a0-4189-aad2-56715cc97163 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:22.254132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85917d-86a0-4189-aad2-56715cc97163 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:22.254412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85917d-86a0-4189-aad2-56715cc97163 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:22.321821 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85917d-86a0-4189-aad2-56715cc97163 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:22.323394 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85917d-86a0-4189-aad2-56715cc97163 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:22.326486 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:22.340491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9fc533-7de2-44f2-9dd3-b29a94ab4da1 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:22.374167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4257507-bb20-4da1-888b-26c1d4ea0662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:22.375030 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4257507-bb20-4da1-888b-26c1d4ea0662 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:22.375310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4257507-bb20-4da1-888b-26c1d4ea0662 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:22.375583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4257507-bb20-4da1-888b-26c1d4ea0662 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:22.376236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4257507-bb20-4da1-888b-26c1d4ea0662 None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:22.376540 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4257507-bb20-4da1-888b-26c1d4ea0662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:22.377771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:22.377910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4257507-bb20-4da1-888b-26c1d4ea0662 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:22.386566 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 252/501] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:22.387358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4257507-bb20-4da1-888b-26c1d4ea0662 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:22.423710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 250/502] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:12:22.424555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85917d-86a0-4189-aad2-56715cc97163 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:22.493302 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4257507-bb20-4da1-888b-26c1d4ea0662 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:22.525190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85917d-86a0-4189-aad2-56715cc97163 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:22.527896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c680d24-677a-4b1b-9810-77d0911ff8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:22.528526 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c680d24-677a-4b1b-9810-77d0911ff8dd None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:22.528810 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c680d24-677a-4b1b-9810-77d0911ff8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:22.529087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c680d24-677a-4b1b-9810-77d0911ff8dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:22.539389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c680d24-677a-4b1b-9810-77d0911ff8dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:22.545364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-3c680d24-677a-4b1b-9810-77d0911ff8dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:22.545364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:22.545364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:22.545364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:22.545364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:22.545364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:22.545364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:22.545364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:22.545364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:22.545364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:22.545364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:22.545364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:22.545364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:22.545364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:22.545364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:22.545364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:22.546313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:22.546313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:22.546313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:22.546313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:22.546313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:22.546313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:22.546313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:22.546313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:22.546313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:22.546313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:22.546313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:22.546313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:22.546313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:22.546313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:22.546313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:22.546313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:22.547098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:22.547098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:22.547098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:22.547098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:22.547098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:22.547098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:22.547098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:22.547098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:22.547098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:22.547098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:22.547098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:22.547098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:22.547098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 253/503] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:22.547897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d65c8-c1e6-4247-b3ac-6669d2fefeea None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:22.547897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d65c8-c1e6-4247-b3ac-6669d2fefeea None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:22.548217 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d65c8-c1e6-4247-b3ac-6669d2fefeea None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:22.550323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 254/504] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:22.551655 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d65c8-c1e6-4247-b3ac-6669d2fefeea None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:22.560971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2984d7d-6ba2-415f-a422-f3f2174362dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:22.561574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2984d7d-6ba2-415f-a422-f3f2174362dc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:22.561856 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2984d7d-6ba2-415f-a422-f3f2174362dc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:22.562156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2984d7d-6ba2-415f-a422-f3f2174362dc None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:22.562882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2984d7d-6ba2-415f-a422-f3f2174362dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:22.563186 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2984d7d-6ba2-415f-a422-f3f2174362dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:22.564604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2984d7d-6ba2-415f-a422-f3f2174362dc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:22.565184 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:22.601155 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 251/505] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 23 16:12:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:22.601904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2984d7d-6ba2-415f-a422-f3f2174362dc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:22.617380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:22.660844 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d65c8-c1e6-4247-b3ac-6669d2fefeea None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:22.694587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088fc3a-e382-42ef-8558-38f969ebf40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:22.695208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088fc3a-e382-42ef-8558-38f969ebf40d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:22.695487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088fc3a-e382-42ef-8558-38f969ebf40d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:22.695767 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088fc3a-e382-42ef-8558-38f969ebf40d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:22.700774 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2984d7d-6ba2-415f-a422-f3f2174362dc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:22.706422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088fc3a-e382-42ef-8558-38f969ebf40d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:22.707894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088fc3a-e382-42ef-8558-38f969ebf40d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:22.722441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-4088fc3a-e382-42ef-8558-38f969ebf40d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:22.722441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:22.722441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:22.722441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:22.722441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:22.722441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:22.722441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:22.722441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:22.722441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:22.722441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:22.722441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:22.722441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:22.722441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:22.722441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:22.722441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:22.722441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:22.723327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:22.723327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:22.723327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:22.723327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:22.723327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:22.723327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:22.723327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:22.723327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:22.723327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:22.723327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:22.723327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:22.723327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:22.723327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:22.723327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:22.723327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:22.723327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:22.723327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:22.724158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:22.724158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:22.724158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:22.724158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 255/506] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:22.724367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088fc3a-e382-42ef-8558-38f969ebf40d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:22.738532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacc41c-ad63-47b2-b151-c14f718f0388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:22.739167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacc41c-ad63-47b2-b151-c14f718f0388 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:22.739451 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacc41c-ad63-47b2-b151-c14f718f0388 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:22.739727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacc41c-ad63-47b2-b151-c14f718f0388 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:22.750456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacc41c-ad63-47b2-b151-c14f718f0388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:22.751909 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cacc41c-ad63-47b2-b151-c14f718f0388 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:22.766354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-9cacc41c-ad63-47b2-b151-c14f718f0388 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:22.766354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:22.766354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:22.766354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:22.766354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:22.766354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:22.766354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:22.766354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:22.766354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:22.766354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:22.766354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:22.766354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:22.766354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:22.766354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:22.766354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:22.766354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:22.767311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:22.767311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:22.767311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:22.767311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:22.767311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:22.767311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:22.767311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:22.767311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:22.767311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:22.767311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:22.767311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:22.767311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:22.767311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:22.767311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:22.767311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:22.767311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:22.767311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:22.768139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:22.768139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:22.768139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:22.768139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 252/507] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:22.769017 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86408b99-e90f-4c33-8190-e5eeed8ddc70 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:22.769311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86408b99-e90f-4c33-8190-e5eeed8ddc70 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:22.769593 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86408b99-e90f-4c33-8190-e5eeed8ddc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:22.786679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:22.788396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-86408b99-e90f-4c33-8190-e5eeed8ddc70 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:22.789781 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-86408b99-e90f-4c33-8190-e5eeed8ddc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:22.825831 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088fc3a-e382-42ef-8558-38f969ebf40d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:22.848041 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:22.856337 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 253/508] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:22.857079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86408b99-e90f-4c33-8190-e5eeed8ddc70 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:22.865355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813565d7-b8b5-48e4-a6eb-ca7dabf2614f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:22.866048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813565d7-b8b5-48e4-a6eb-ca7dabf2614f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:22.866365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813565d7-b8b5-48e4-a6eb-ca7dabf2614f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:22.866641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813565d7-b8b5-48e4-a6eb-ca7dabf2614f None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:22.867310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813565d7-b8b5-48e4-a6eb-ca7dabf2614f None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:22.867753 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813565d7-b8b5-48e4-a6eb-ca7dabf2614f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:22.869427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813565d7-b8b5-48e4-a6eb-ca7dabf2614f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:22.878154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 256/509] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:22.878971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813565d7-b8b5-48e4-a6eb-ca7dabf2614f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:22.968709 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86408b99-e90f-4c33-8190-e5eeed8ddc70 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:22.985762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813565d7-b8b5-48e4-a6eb-ca7dabf2614f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:23.003174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de888766-a519-4649-8fc5-ee743f2653f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:23.003785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de888766-a519-4649-8fc5-ee743f2653f1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:23.004076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de888766-a519-4649-8fc5-ee743f2653f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:23.004355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de888766-a519-4649-8fc5-ee743f2653f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:23.012533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:23.025483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8947905-a3c9-4ef6-9829-f540f3a02d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:23.026127 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8947905-a3c9-4ef6-9829-f540f3a02d26 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:23.026411 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8947905-a3c9-4ef6-9829-f540f3a02d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:23.026684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8947905-a3c9-4ef6-9829-f540f3a02d26 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:23.027347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8947905-a3c9-4ef6-9829-f540f3a02d26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:23.027630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8947905-a3c9-4ef6-9829-f540f3a02d26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:23.029017 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8947905-a3c9-4ef6-9829-f540f3a02d26 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:23.041206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 257/510] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:23.042009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8947905-a3c9-4ef6-9829-f540f3a02d26 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:23.072926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:23.081471 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de888766-a519-4649-8fc5-ee743f2653f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:23.082978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de888766-a519-4649-8fc5-ee743f2653f1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:23.143512 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8947905-a3c9-4ef6-9829-f540f3a02d26 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:23.178858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be65c95-72d4-4f24-942c-6dc8db576ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:23.179347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be65c95-72d4-4f24-942c-6dc8db576ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:23.179630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be65c95-72d4-4f24-942c-6dc8db576ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:23.179903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be65c95-72d4-4f24-942c-6dc8db576ea6 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:23.180548 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be65c95-72d4-4f24-942c-6dc8db576ea6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:23.180852 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be65c95-72d4-4f24-942c-6dc8db576ea6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:23.182285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be65c95-72d4-4f24-942c-6dc8db576ea6 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:23.182883 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 254/511] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:12:23.183729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de888766-a519-4649-8fc5-ee743f2653f1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:23.197806 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 258/512] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:23.198669 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be65c95-72d4-4f24-942c-6dc8db576ea6 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:23.243388 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:23.284718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:23.291319 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de888766-a519-4649-8fc5-ee743f2653f1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:23.302527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be65c95-72d4-4f24-942c-6dc8db576ea6 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:23.325532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013543c9-984c-48ff-930d-20773d38bdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:23.326191 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013543c9-984c-48ff-930d-20773d38bdeb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:23.326478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013543c9-984c-48ff-930d-20773d38bdeb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:23.326770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013543c9-984c-48ff-930d-20773d38bdeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:23.336525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbcb54-698f-40e8-8a17-bb3031439c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:23.336651 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013543c9-984c-48ff-930d-20773d38bdeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:23.337149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbcb54-698f-40e8-8a17-bb3031439c40 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:23.337464 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbcb54-698f-40e8-8a17-bb3031439c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:23.337741 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbcb54-698f-40e8-8a17-bb3031439c40 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:23.338078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013543c9-984c-48ff-930d-20773d38bdeb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:23.345278 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbcb54-698f-40e8-8a17-bb3031439c40 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:23.346733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbcb54-698f-40e8-8a17-bb3031439c40 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:23.352840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-013543c9-984c-48ff-930d-20773d38bdeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:23.352840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:23.352840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:23.352840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:23.352840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:23.352840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:23.352840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:23.352840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:23.352840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:23.352840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:23.352840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:23.352840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:23.352840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:23.352840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:23.352840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:23.352840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:23.354336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:23.354336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:23.354336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:23.354336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:23.354336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:23.354336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:23.354336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:23.354336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:23.354336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:23.354336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:23.354336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:23.354336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:23.354336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:23.354336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:23.354336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:23.354336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:23.354336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:23.355204 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:23.355204 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:23.355204 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:23.355204 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 255/513] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:23.355425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013543c9-984c-48ff-930d-20773d38bdeb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:23.358303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-a1dbcb54-698f-40e8-8a17-bb3031439c40 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:12:23.358303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:23.358303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:23.358303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:23.358303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:23.358303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:23.358303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:23.358303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:23.358303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:23.358303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:23.358303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:23.358303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:23.358303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:23.358303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:23.358303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:23.358303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:23.359294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:23.359294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:23.359294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:23.359294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:23.359294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:23.359294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:23.359294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:23.359294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:23.359294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:23.359294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:23.359294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:23.359294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:23.359294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:23.359294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:23.359294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:23.359294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:23.359294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:23.359294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:23.360187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:23.360187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:23.360187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:23.360187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:23.360187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:23.360187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:23.360187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:23.360187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:23.360187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:12:23.360187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:23.360187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 259/514] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:23.360726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbcb54-698f-40e8-8a17-bb3031439c40 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:23.456873 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013543c9-984c-48ff-930d-20773d38bdeb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:23.463770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbcb54-698f-40e8-8a17-bb3031439c40 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:23.467037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:23.491165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac425af-2097-41d1-9fc9-f8f0c2e6fd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:23.491795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac425af-2097-41d1-9fc9-f8f0c2e6fd30 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:23.492073 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac425af-2097-41d1-9fc9-f8f0c2e6fd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:23.492348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac425af-2097-41d1-9fc9-f8f0c2e6fd30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:23.502448 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a193d0-f53b-4f59-981f-605874d2ee52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:23.503167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a193d0-f53b-4f59-981f-605874d2ee52 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:23.503447 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a193d0-f53b-4f59-981f-605874d2ee52 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:23.503712 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a193d0-f53b-4f59-981f-605874d2ee52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:23.505043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac425af-2097-41d1-9fc9-f8f0c2e6fd30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:23.506527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac425af-2097-41d1-9fc9-f8f0c2e6fd30 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:23.514571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a193d0-f53b-4f59-981f-605874d2ee52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:23.515503 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:23.516295 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a193d0-f53b-4f59-981f-605874d2ee52 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:23.522059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-cac425af-2097-41d1-9fc9-f8f0c2e6fd30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:23.522059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:23.522059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:23.522059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:23.522059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:23.522059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:23.522059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:23.522059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:23.522059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:23.522059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:23.522059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:23.522059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:23.522059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:23.522059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:23.522059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:23.522059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:23.523192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:23.523192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:23.523192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:23.523192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:23.523192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:23.523192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:23.523192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:23.523192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:23.523192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:23.523192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:23.523192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:23.523192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:23.523192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:23.523192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:23.523192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:23.523192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:23.523192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:23.524147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:23.524147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:23.524147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:23.524147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 256/515] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:23.526042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac425af-2097-41d1-9fc9-f8f0c2e6fd30 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:23.530874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-72a193d0-f53b-4f59-981f-605874d2ee52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:23.530874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:23.530874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:23.530874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:23.530874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:23.530874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:23.530874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:23.530874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:23.530874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:23.530874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:23.530874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:23.530874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:23.530874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:23.530874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:23.530874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:23.530874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:23.531958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:23.531958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:23.531958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:23.531958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:23.531958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:23.531958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:23.531958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:23.531958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:23.531958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:23.531958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:23.531958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:23.531958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:23.531958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:23.531958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:23.531958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:23.531958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:23.531958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:23.532790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:23.532790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:23.532790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:23.532790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 260/516] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:23.532790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a193d0-f53b-4f59-981f-605874d2ee52 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:23.626915 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac425af-2097-41d1-9fc9-f8f0c2e6fd30 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:23.638885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a193d0-f53b-4f59-981f-605874d2ee52 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:23.660799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c1de0-25e6-4550-aac3-251d2b448ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:23.661427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c1de0-25e6-4550-aac3-251d2b448ddc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:23.661707 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c1de0-25e6-4550-aac3-251d2b448ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:23.661983 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c1de0-25e6-4550-aac3-251d2b448ddc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:23.668761 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c1de0-25e6-4550-aac3-251d2b448ddc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:23.670227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c1de0-25e6-4550-aac3-251d2b448ddc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:23.671921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7326cfb-c9ef-48da-ae1c-697e787dcf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:23.672518 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7326cfb-c9ef-48da-ae1c-697e787dcf87 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:23.672800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7326cfb-c9ef-48da-ae1c-697e787dcf87 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:23.673072 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7326cfb-c9ef-48da-ae1c-697e787dcf87 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:23.673708 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7326cfb-c9ef-48da-ae1c-697e787dcf87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:23.674013 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7326cfb-c9ef-48da-ae1c-697e787dcf87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:23.675383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7326cfb-c9ef-48da-ae1c-697e787dcf87 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:23.682606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-ae9c1de0-25e6-4550-aac3-251d2b448ddc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:23.682606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:23.682606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:23.682606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:23.682606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:23.682606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:23.682606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:23.682606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:23.682606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:23.682606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:23.682606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:23.682606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:23.682606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:23.682606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:23.682606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:23.683430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:23.683430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:23.683430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:23.683430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:23.683430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:23.683430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:23.683430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:23.683430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:23.683430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:23.683430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:23.683430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:23.683430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:23.683430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:23.683430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:23.683430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:23.683430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:23.683430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:23.684259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:23.684259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:23.684259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:23.684259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:23.684259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:23.684259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:23.684259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:23.684259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:23.684259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 257/517] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:23.685581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c1de0-25e6-4550-aac3-251d2b448ddc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:23.690416 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 261/518] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:23.691096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7326cfb-c9ef-48da-ae1c-697e787dcf87 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:23.708998 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:23.743009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:23.783827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c1de0-25e6-4550-aac3-251d2b448ddc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:23.789974 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7326cfb-c9ef-48da-ae1c-697e787dcf87 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:23.817075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc325e-73a0-4c4c-a9e9-43e69aeb4591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:23.817676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc325e-73a0-4c4c-a9e9-43e69aeb4591 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:23.817959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc325e-73a0-4c4c-a9e9-43e69aeb4591 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:23.818504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc325e-73a0-4c4c-a9e9-43e69aeb4591 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:23.818992 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc325e-73a0-4c4c-a9e9-43e69aeb4591 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:23.819302 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc325e-73a0-4c4c-a9e9-43e69aeb4591 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:23.820729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc325e-73a0-4c4c-a9e9-43e69aeb4591 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:23.823503 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c270e10-5c0b-4f94-a70c-845c183631a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:23.824105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c270e10-5c0b-4f94-a70c-845c183631a8 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:23.824381 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c270e10-5c0b-4f94-a70c-845c183631a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:23.824647 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c270e10-5c0b-4f94-a70c-845c183631a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:23.825277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c270e10-5c0b-4f94-a70c-845c183631a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:23.825576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c270e10-5c0b-4f94-a70c-845c183631a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:23.826956 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c270e10-5c0b-4f94-a70c-845c183631a8 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:23.842617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 262/519] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:23.842796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 258/520] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 23 16:12:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:23.842876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c270e10-5c0b-4f94-a70c-845c183631a8 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:23.842955 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc325e-73a0-4c4c-a9e9-43e69aeb4591 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:23.919550 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:23.940569 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc325e-73a0-4c4c-a9e9-43e69aeb4591 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:23.942697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c270e10-5c0b-4f94-a70c-845c183631a8 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:23.958366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:23.975060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae111aca-369a-4460-af35-a08f9155b45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:23.975592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae111aca-369a-4460-af35-a08f9155b45d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:23.975873 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae111aca-369a-4460-af35-a08f9155b45d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:23.975967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a54de-92da-454e-a698-dc39ac16e578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:23.976148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae111aca-369a-4460-af35-a08f9155b45d None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:23.976463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a54de-92da-454e-a698-dc39ac16e578 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:23.976740 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a54de-92da-454e-a698-dc39ac16e578 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:23.976828 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae111aca-369a-4460-af35-a08f9155b45d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:23.977008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a54de-92da-454e-a698-dc39ac16e578 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:23.977132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae111aca-369a-4460-af35-a08f9155b45d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:23.977633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a54de-92da-454e-a698-dc39ac16e578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:23.977953 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a54de-92da-454e-a698-dc39ac16e578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:23.978630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae111aca-369a-4460-af35-a08f9155b45d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:23.979491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a54de-92da-454e-a698-dc39ac16e578 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:23.990901 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 263/521] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:23.991678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a54de-92da-454e-a698-dc39ac16e578 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:23.999317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 259/522] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:24.000140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae111aca-369a-4460-af35-a08f9155b45d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:24.090815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a54de-92da-454e-a698-dc39ac16e578 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:24.100321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae111aca-369a-4460-af35-a08f9155b45d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:24.124902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b7c8b-c4e1-45ce-a124-43f4185f8f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:24.125549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b7c8b-c4e1-45ce-a124-43f4185f8f55 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:24.125823 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b7c8b-c4e1-45ce-a124-43f4185f8f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:24.126122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b7c8b-c4e1-45ce-a124-43f4185f8f55 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:24.128809 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:24.133576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea875c2-ebac-4ec9-9425-cc9b2ad901e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:24.133765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b7c8b-c4e1-45ce-a124-43f4185f8f55 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:24.134760 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea875c2-ebac-4ec9-9425-cc9b2ad901e0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:24.135423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea875c2-ebac-4ec9-9425-cc9b2ad901e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:24.135423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea875c2-ebac-4ec9-9425-cc9b2ad901e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:24.136136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b7c8b-c4e1-45ce-a124-43f4185f8f55 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:24.147860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-e05b7c8b-c4e1-45ce-a124-43f4185f8f55 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:12:24.147860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:24.147860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:24.147860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:24.147860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:24.147860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:24.147860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:24.147860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:24.147860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:24.147860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:24.147860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:24.147860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:24.147860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:24.147860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:24.147860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:24.147860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:24.148786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:24.148786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:24.148786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:24.148786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:24.148786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:24.148786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:24.148786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:24.148786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:24.148786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:24.148786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:24.148786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:24.148786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:24.148786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:24.148786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:24.148786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:24.148786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:24.148786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:24.148786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:24.150206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:24.150206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:24.150206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:24.150206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:24.150206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:24.150206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:24.150206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:24.150206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:24.150206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:12:24.150206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:24.150206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 264/523] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:24.150206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b7c8b-c4e1-45ce-a124-43f4185f8f55 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:24.189021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:24.211005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea875c2-ebac-4ec9-9425-cc9b2ad901e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:24.213155 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea875c2-ebac-4ec9-9425-cc9b2ad901e0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:24.255928 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b7c8b-c4e1-45ce-a124-43f4185f8f55 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:24.290715 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62080104-46c6-4a77-8abf-150b46501216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:24.291330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62080104-46c6-4a77-8abf-150b46501216 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:24.291615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62080104-46c6-4a77-8abf-150b46501216 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:24.291893 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62080104-46c6-4a77-8abf-150b46501216 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:24.292937 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62080104-46c6-4a77-8abf-150b46501216 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:24.294420 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62080104-46c6-4a77-8abf-150b46501216 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:24.315317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 265/524] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 16:12:24 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:12:24.316145 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62080104-46c6-4a77-8abf-150b46501216 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:24.323246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 260/525] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:12:24.323246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea875c2-ebac-4ec9-9425-cc9b2ad901e0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:24.383027 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:24.408954 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:24.441350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea875c2-ebac-4ec9-9425-cc9b2ad901e0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:24.443180 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62080104-46c6-4a77-8abf-150b46501216 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:24.482144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f340297-3f3c-4f81-b25c-d7ff26b8b12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:24.482933 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f340297-3f3c-4f81-b25c-d7ff26b8b12d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:24.483326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f340297-3f3c-4f81-b25c-d7ff26b8b12d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:24.483689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f340297-3f3c-4f81-b25c-d7ff26b8b12d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:24.484127 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfe688-bdec-4ec8-bc47-b276ae34dde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:24.484737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfe688-bdec-4ec8-bc47-b276ae34dde9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:24.485021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfe688-bdec-4ec8-bc47-b276ae34dde9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:24.485306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfe688-bdec-4ec8-bc47-b276ae34dde9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:24.486031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfe688-bdec-4ec8-bc47-b276ae34dde9 None admin] RBAC: Adding query filter params (role.id=bbf63b75406649a3b653308ecb75062d, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=767ca33ca8e244f8a0cc773e3b6abefb) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:24.486396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfe688-bdec-4ec8-bc47-b276ae34dde9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:24.487828 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfe688-bdec-4ec8-bc47-b276ae34dde9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:24.491991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f340297-3f3c-4f81-b25c-d7ff26b8b12d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:24.494133 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f340297-3f3c-4f81-b25c-d7ff26b8b12d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:24.495315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 261/526] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:12:24 2022] GET /identity/v3/role_assignments?user.id=767ca33ca8e244f8a0cc773e3b6abefb&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=bbf63b75406649a3b653308ecb75062d => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:24.496813 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfe688-bdec-4ec8-bc47-b276ae34dde9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:24.508732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-1f340297-3f3c-4f81-b25c-d7ff26b8b12d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:24.508732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:24.508732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:24.508732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:24.508732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:24.508732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:24.508732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:24.508732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:24.508732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:24.508732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:24.508732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:24.508732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:24.508732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:24.508732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:24.508732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:24.510441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:24.510441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:24.510441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:24.510441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:24.510441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:24.510441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:24.510441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:24.510441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:24.510441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:24.510441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:24.510441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:24.510441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:24.510441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:24.510441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:24.510441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:24.510441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:24.510441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:24.511618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:24.511618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:24.511618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:24.511618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:24.511618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:24.511618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:24.511618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:24.511618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:24.512160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 266/527] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:24.516380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f340297-3f3c-4f81-b25c-d7ff26b8b12d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:24.642402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfe688-bdec-4ec8-bc47-b276ae34dde9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:24.664263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f340297-3f3c-4f81-b25c-d7ff26b8b12d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:24.682646 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:24.685190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da411790-e701-46c3-b8c3-a20bbd6f0db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:24.686119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da411790-e701-46c3-b8c3-a20bbd6f0db7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:24.686469 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da411790-e701-46c3-b8c3-a20bbd6f0db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:24.686750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da411790-e701-46c3-b8c3-a20bbd6f0db7 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:24.687797 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da411790-e701-46c3-b8c3-a20bbd6f0db7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:24.688106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da411790-e701-46c3-b8c3-a20bbd6f0db7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:24.690038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da411790-e701-46c3-b8c3-a20bbd6f0db7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:24.710614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b670144-77f5-4e10-977f-fcff56a87994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:24.711390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b670144-77f5-4e10-977f-fcff56a87994 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:24.711787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b670144-77f5-4e10-977f-fcff56a87994 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:24.712164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b670144-77f5-4e10-977f-fcff56a87994 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:24.712539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:24.715375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 262/528] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 23 16:12:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:24.717946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da411790-e701-46c3-b8c3-a20bbd6f0db7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:24.730102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b670144-77f5-4e10-977f-fcff56a87994 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:24.731485 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b670144-77f5-4e10-977f-fcff56a87994 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:24.746921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-4b670144-77f5-4e10-977f-fcff56a87994 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:24.746921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:24.746921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:24.746921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:24.746921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:24.746921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:24.746921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:24.746921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:24.746921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:24.746921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:24.746921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:24.746921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:24.746921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:24.746921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:24.746921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:24.746921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:24.748075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:24.748075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:24.748075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:24.748075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:24.748075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:24.748075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:24.748075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:24.748075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:24.748075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:24.748075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:24.748075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:24.748075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:24.748075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:24.748075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:24.748075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:24.748075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:24.748075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:24.749107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:24.749107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:24.749107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:24.754763 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 267/529] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:24.754763 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b670144-77f5-4e10-977f-fcff56a87994 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:24.843774 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da411790-e701-46c3-b8c3-a20bbd6f0db7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:24.856343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b670144-77f5-4e10-977f-fcff56a87994 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:24.878901 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6255c0-c4db-4f8c-99ac-6cb015b021f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:24.879513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6255c0-c4db-4f8c-99ac-6cb015b021f0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:24.879795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6255c0-c4db-4f8c-99ac-6cb015b021f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:24.880068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6255c0-c4db-4f8c-99ac-6cb015b021f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:24.880765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6255c0-c4db-4f8c-99ac-6cb015b021f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:24.881070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6255c0-c4db-4f8c-99ac-6cb015b021f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:24.882603 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6255c0-c4db-4f8c-99ac-6cb015b021f0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:24.892117 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2502cff-7fb8-4fcc-b314-49436a099c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:24.892863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2502cff-7fb8-4fcc-b314-49436a099c35 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:24.893233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2502cff-7fb8-4fcc-b314-49436a099c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:24.893616 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2502cff-7fb8-4fcc-b314-49436a099c35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:24.896291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 263/530] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:24.897850 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6255c0-c4db-4f8c-99ac-6cb015b021f0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:24.934110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:24.980845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2502cff-7fb8-4fcc-b314-49436a099c35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:24.982906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2502cff-7fb8-4fcc-b314-49436a099c35 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:25.002432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:25.011611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6255c0-c4db-4f8c-99ac-6cb015b021f0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:25.060543 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81a4aa-826c-4085-add0-5a57a5703dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:25.062027 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81a4aa-826c-4085-add0-5a57a5703dbe None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:25.062344 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81a4aa-826c-4085-add0-5a57a5703dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:25.062620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81a4aa-826c-4085-add0-5a57a5703dbe None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:25.063273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81a4aa-826c-4085-add0-5a57a5703dbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:25.063581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81a4aa-826c-4085-add0-5a57a5703dbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:25.064968 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81a4aa-826c-4085-add0-5a57a5703dbe None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:25.086239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 264/531] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:25.087192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81a4aa-826c-4085-add0-5a57a5703dbe None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:25.105685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 268/532] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:12:25.106703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2502cff-7fb8-4fcc-b314-49436a099c35 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:25.186401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:25.209025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81a4aa-826c-4085-add0-5a57a5703dbe None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:25.231974 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:25.238310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2502cff-7fb8-4fcc-b314-49436a099c35 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:25.249007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9b7fe-dd66-4b57-93fa-b52a4a7333aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:25.249566 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9b7fe-dd66-4b57-93fa-b52a4a7333aa None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:25.250011 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9b7fe-dd66-4b57-93fa-b52a4a7333aa None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:25.250415 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9b7fe-dd66-4b57-93fa-b52a4a7333aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:25.251259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9b7fe-dd66-4b57-93fa-b52a4a7333aa None admin] RBAC: Adding query filter params (role.id=bbf63b75406649a3b653308ecb75062d, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=d3ddab91bbb24d119dd302024f458d35) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:25.251799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9b7fe-dd66-4b57-93fa-b52a4a7333aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:25.253501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9b7fe-dd66-4b57-93fa-b52a4a7333aa None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:25.259916 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 265/533] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:12:25 2022] GET /identity/v3/role_assignments?user.id=d3ddab91bbb24d119dd302024f458d35&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=bbf63b75406649a3b653308ecb75062d => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:25.267234 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9b7fe-dd66-4b57-93fa-b52a4a7333aa None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:25.283386 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd73f00-fd16-40f2-8d77-a7f2b0cdef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:25.284903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd73f00-fd16-40f2-8d77-a7f2b0cdef71 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:25.285316 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd73f00-fd16-40f2-8d77-a7f2b0cdef71 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:25.285748 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd73f00-fd16-40f2-8d77-a7f2b0cdef71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:25.295174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd73f00-fd16-40f2-8d77-a7f2b0cdef71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:25.297416 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd73f00-fd16-40f2-8d77-a7f2b0cdef71 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:25.313219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-ccd73f00-fd16-40f2-8d77-a7f2b0cdef71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:25.313219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:25.313219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:25.313219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:25.313219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:25.313219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:25.313219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:25.313219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:25.313219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:25.313219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:25.313219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:25.313219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:25.313219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:25.313219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:25.313219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:25.314350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:25.314350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:25.314350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:25.314350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:25.314350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:25.314350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:25.314350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:25.314350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:25.314350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:25.314350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:25.314350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:25.314350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:25.314350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:25.314350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:25.314350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:25.314350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:25.314350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:25.315398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:25.315398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:25.315398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:25.315398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:25.315398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:25.315398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:25.315398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:25.315398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:25.317441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 269/534] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:25.324773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd73f00-fd16-40f2-8d77-a7f2b0cdef71 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:25.490099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd73f00-fd16-40f2-8d77-a7f2b0cdef71 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:25.500121 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9b7fe-dd66-4b57-93fa-b52a4a7333aa None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:25.548462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:25.566154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b8334-f5ce-4255-a6ab-f7faed50c2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:25.566797 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b8334-f5ce-4255-a6ab-f7faed50c2ed None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:25.567080 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b8334-f5ce-4255-a6ab-f7faed50c2ed None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:25.567349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b8334-f5ce-4255-a6ab-f7faed50c2ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:25.572516 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f85fbb-5a69-4954-bf86-d7cff64cf016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:25.573232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f85fbb-5a69-4954-bf86-d7cff64cf016 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:25.573510 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f85fbb-5a69-4954-bf86-d7cff64cf016 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:25.573776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f85fbb-5a69-4954-bf86-d7cff64cf016 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:25.574504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f85fbb-5a69-4954-bf86-d7cff64cf016 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:25.574810 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f85fbb-5a69-4954-bf86-d7cff64cf016 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:25.576248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f85fbb-5a69-4954-bf86-d7cff64cf016 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:25.596477 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b8334-f5ce-4255-a6ab-f7faed50c2ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:25.597937 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b8334-f5ce-4255-a6ab-f7faed50c2ed None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:25.613394 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 270/535] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:25.620152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f85fbb-5a69-4954-bf86-d7cff64cf016 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:25.621359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-d95b8334-f5ce-4255-a6ab-f7faed50c2ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:25.621359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:25.621359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:25.621359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:25.621359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:25.621359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:25.621359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:25.621359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:25.621359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:25.621359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:25.621359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:25.621359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:25.621359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:25.621359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:25.621359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:25.621359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:25.622272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:25.622272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:25.622272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:25.622272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:25.622272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:25.622272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:25.622272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:25.622272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:25.622272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:25.622272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:25.622272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:25.622272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:25.622272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:25.622272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:25.622272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:25.622272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:25.622272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:25.623106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:25.623106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:25.623106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:25.623106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 266/536] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:25.631371 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b8334-f5ce-4255-a6ab-f7faed50c2ed None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:25.708934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:25.780605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f85fbb-5a69-4954-bf86-d7cff64cf016 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:25.788568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b8334-f5ce-4255-a6ab-f7faed50c2ed None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:25.816422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f7bc7-7e8b-43b4-98c3-f9024cdb9832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:25.817030 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f7bc7-7e8b-43b4-98c3-f9024cdb9832 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:25.817311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f7bc7-7e8b-43b4-98c3-f9024cdb9832 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:25.817583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f7bc7-7e8b-43b4-98c3-f9024cdb9832 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:25.818341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f7bc7-7e8b-43b4-98c3-f9024cdb9832 None admin] RBAC: Adding query filter params (role.id=bbf63b75406649a3b653308ecb75062d, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=9eae00506f75402fbf972a8991ad0a68) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:25.818652 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f7bc7-7e8b-43b4-98c3-f9024cdb9832 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:25.820144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f7bc7-7e8b-43b4-98c3-f9024cdb9832 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:25.825877 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35010d2-7311-42db-9e10-7a30961054ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:25.826512 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35010d2-7311-42db-9e10-7a30961054ed None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:25.826791 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35010d2-7311-42db-9e10-7a30961054ed None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:25.826895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 271/537] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:12:25 2022] GET /identity/v3/role_assignments?user.id=9eae00506f75402fbf972a8991ad0a68&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=bbf63b75406649a3b653308ecb75062d => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:25.827061 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35010d2-7311-42db-9e10-7a30961054ed None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:25.827704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35010d2-7311-42db-9e10-7a30961054ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:25.828037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35010d2-7311-42db-9e10-7a30961054ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:25.829355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35010d2-7311-42db-9e10-7a30961054ed None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:25.843436 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 267/538] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:25.849058 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f7bc7-7e8b-43b4-98c3-f9024cdb9832 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:25.904333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:25.984406 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f7bc7-7e8b-43b4-98c3-f9024cdb9832 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:26.028565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0813b-c422-4174-b5f0-96498aacd655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:26.029201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0813b-c422-4174-b5f0-96498aacd655 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:26.029479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0813b-c422-4174-b5f0-96498aacd655 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:26.029756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0813b-c422-4174-b5f0-96498aacd655 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:26.037139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0813b-c422-4174-b5f0-96498aacd655 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:26.038557 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d0813b-c422-4174-b5f0-96498aacd655 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:26.050435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-a0d0813b-c422-4174-b5f0-96498aacd655 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:26.050435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:26.050435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:26.050435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:26.050435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:26.050435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:26.050435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:26.050435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:26.050435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:26.050435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:26.050435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:26.050435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:26.050435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:26.050435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:26.050435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:26.051372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:26.051372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:26.051372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:26.051372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:26.051372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:26.051372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:26.051372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:26.051372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:26.051372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:26.051372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:26.051372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:26.051372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:26.051372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:26.051372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:26.051372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:26.051372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:26.051372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:26.052240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:26.052240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:26.052240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:26.052240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:26.052240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:26.052240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:26.052240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:26.052240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:26.052240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 272/539] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:26.059386 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35010d2-7311-42db-9e10-7a30961054ed None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:26.193323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:26.203558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35010d2-7311-42db-9e10-7a30961054ed None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:26.258774 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727cb32-ed43-4238-8e09-bb56d4b66da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:26.259623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727cb32-ed43-4238-8e09-bb56d4b66da6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:26.259985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727cb32-ed43-4238-8e09-bb56d4b66da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:26.260263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727cb32-ed43-4238-8e09-bb56d4b66da6 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:26.260970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727cb32-ed43-4238-8e09-bb56d4b66da6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:26.261281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727cb32-ed43-4238-8e09-bb56d4b66da6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:26.262747 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727cb32-ed43-4238-8e09-bb56d4b66da6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:26.282155 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 268/540] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:26.288526 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0813b-c422-4174-b5f0-96498aacd655 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:26.412899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0813b-c422-4174-b5f0-96498aacd655 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:26.424086 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:26.462925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ab887-b592-4545-aa5c-833a62c3c403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:26.463941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ab887-b592-4545-aa5c-833a62c3c403 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:26.464420 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ab887-b592-4545-aa5c-833a62c3c403 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:26.464889 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ab887-b592-4545-aa5c-833a62c3c403 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:26.465833 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ab887-b592-4545-aa5c-833a62c3c403 None admin] RBAC: Adding query filter params (role.id=bbf63b75406649a3b653308ecb75062d, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=8ffa4002b4b24e6e9665dc349ad2f1b6) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:26.466553 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ab887-b592-4545-aa5c-833a62c3c403 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:26.468701 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ab887-b592-4545-aa5c-833a62c3c403 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:26.475028 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 273/541] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:12:26 2022] GET /identity/v3/role_assignments?user.id=8ffa4002b4b24e6e9665dc349ad2f1b6&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=bbf63b75406649a3b653308ecb75062d => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:26.594159 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb69071-45b2-44d6-b39e-aa137e858bbf None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:26.594543 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb69071-45b2-44d6-b39e-aa137e858bbf None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:26.594730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb69071-45b2-44d6-b39e-aa137e858bbf None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:26.596454 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 269/542] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:26.602376 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33462c-6c0e-44d0-abe2-b0399d26a60c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:26.603004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33462c-6c0e-44d0-abe2-b0399d26a60c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:26.603564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33462c-6c0e-44d0-abe2-b0399d26a60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:26.627815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-ce33462c-6c0e-44d0-abe2-b0399d26a60c None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:26.629464 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ce33462c-6c0e-44d0-abe2-b0399d26a60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:26.702608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a0c9a-ab43-4166-a2cd-9fa59647bb31 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:26.702903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a0c9a-ab43-4166-a2cd-9fa59647bb31 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:26.703166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a0c9a-ab43-4166-a2cd-9fa59647bb31 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:26.704748 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 270/543] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:26.710402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758452bb-fc50-40cd-8213-9b899061ebb9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:26.710697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758452bb-fc50-40cd-8213-9b899061ebb9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:26.710981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758452bb-fc50-40cd-8213-9b899061ebb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:26.721481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 274/544] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:26.751075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-758452bb-fc50-40cd-8213-9b899061ebb9 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:26.752305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-758452bb-fc50-40cd-8213-9b899061ebb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:26.861118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 271/545] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:12:27.017668 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33462c-6c0e-44d0-abe2-b0399d26a60c None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:27.147700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33462c-6c0e-44d0-abe2-b0399d26a60c None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:27.149396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:27.210794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a42333-5dbc-4694-af23-6ed4c3a5bd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:27.211447 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a42333-5dbc-4694-af23-6ed4c3a5bd3d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:27.211733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a42333-5dbc-4694-af23-6ed4c3a5bd3d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:27.212005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a42333-5dbc-4694-af23-6ed4c3a5bd3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:27.226949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a42333-5dbc-4694-af23-6ed4c3a5bd3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:27.229876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758452bb-fc50-40cd-8213-9b899061ebb9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:27.232702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-41a42333-5dbc-4694-af23-6ed4c3a5bd3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:27.232702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:27.232702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:27.232702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:27.232702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:27.232702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:27.232702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:27.232702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:27.232702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:27.232702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:27.232702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:27.232702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:27.232702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:27.232702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:27.232702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:27.232702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:27.233565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:27.233565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:27.233565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:27.233565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:27.233565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:27.233565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:27.233565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:27.233565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:27.233565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:27.233565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:27.233565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:27.233565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:27.233565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:27.233565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:27.233565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:27.233565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:27.234375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:27.234375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:27.234375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:27.234375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:27.234375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:27.234375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:27.234375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:27.234375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:27.234375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:27.234375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:27.234375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:27.234375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:27.236064 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 275/546] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:27.241211 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a42333-5dbc-4694-af23-6ed4c3a5bd3d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:27.383441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:27.395922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758452bb-fc50-40cd-8213-9b899061ebb9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:27.438268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044e6a7-db35-49ac-a8fc-04ef967e1492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:27.438268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044e6a7-db35-49ac-a8fc-04ef967e1492 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:27.438268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044e6a7-db35-49ac-a8fc-04ef967e1492 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:27.438268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044e6a7-db35-49ac-a8fc-04ef967e1492 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:27.449206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a42333-5dbc-4694-af23-6ed4c3a5bd3d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:27.456781 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044e6a7-db35-49ac-a8fc-04ef967e1492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:27.467105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-d044e6a7-db35-49ac-a8fc-04ef967e1492 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:27.467105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:27.467105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:27.467105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:27.467105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:27.467105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:27.467105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:27.467105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:27.467105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:27.467105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:27.467105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:27.467105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:27.467105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:27.467105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:27.467105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:27.467105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:27.468226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:27.468226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:27.468226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:27.468226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:27.468226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:27.468226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:27.468226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:27.468226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:27.468226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:27.468226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:27.468226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:27.468226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:27.468226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:27.468226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:27.468226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:27.468226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:27.469231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:27.469231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:27.469231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:27.469231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:27.469231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:27.469231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:27.469231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:27.469231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:27.469231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:27.469231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:27.469231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:27.469231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:27.472864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 272/547] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:12:27.479043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044e6a7-db35-49ac-a8fc-04ef967e1492 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:27.539555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e739be5-7112-4024-b144-aef7e7d7025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:27.539957 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e739be5-7112-4024-b144-aef7e7d7025e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:27.540245 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e739be5-7112-4024-b144-aef7e7d7025e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:27.541122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e739be5-7112-4024-b144-aef7e7d7025e None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:27.541808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e739be5-7112-4024-b144-aef7e7d7025e None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:27.542137 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e739be5-7112-4024-b144-aef7e7d7025e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:27.543537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e739be5-7112-4024-b144-aef7e7d7025e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:27.566151 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 276/548] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:27.579652 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e739be5-7112-4024-b144-aef7e7d7025e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:27.601877 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044e6a7-db35-49ac-a8fc-04ef967e1492 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:27.635550 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:27.640643 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee6176-8123-436e-b8ae-07c5aa5cba72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:27.641450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee6176-8123-436e-b8ae-07c5aa5cba72 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:27.641879 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee6176-8123-436e-b8ae-07c5aa5cba72 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:27.642350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee6176-8123-436e-b8ae-07c5aa5cba72 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:27.643166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee6176-8123-436e-b8ae-07c5aa5cba72 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:27.643710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee6176-8123-436e-b8ae-07c5aa5cba72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:27.645300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee6176-8123-436e-b8ae-07c5aa5cba72 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:27.655734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 273/549] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:27.663865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee6176-8123-436e-b8ae-07c5aa5cba72 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:27.674451 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:27.769958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee6176-8123-436e-b8ae-07c5aa5cba72 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:27.802953 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e739be5-7112-4024-b144-aef7e7d7025e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:27.830592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590b4ee-30b1-4179-9772-4167ff4fc22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:27.831235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590b4ee-30b1-4179-9772-4167ff4fc22e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:27.831516 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590b4ee-30b1-4179-9772-4167ff4fc22e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:27.831792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590b4ee-30b1-4179-9772-4167ff4fc22e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:27.851281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590b4ee-30b1-4179-9772-4167ff4fc22e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:27.853048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590b4ee-30b1-4179-9772-4167ff4fc22e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:27.863030 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2fda4-c850-443d-a6aa-4851225a4d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:27.864448 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2fda4-c850-443d-a6aa-4851225a4d8d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:27.865237 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2fda4-c850-443d-a6aa-4851225a4d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:27.865746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2fda4-c850-443d-a6aa-4851225a4d8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:27.871026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-6590b4ee-30b1-4179-9772-4167ff4fc22e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:27.871026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:27.871026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:27.871026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:27.871026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:27.871026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:27.871026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:27.871026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:27.871026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:27.871026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:27.871026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:27.871026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:27.871026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:27.871026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:27.871026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:27.871026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:27.873239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:27.873239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:27.873239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:27.873239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:27.873239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:27.873239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:27.873239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:27.873239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:27.873239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:27.873239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:27.873239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:27.873239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:27.873239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:27.873239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:27.873239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:27.873239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:27.873239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:27.874207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:27.874207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:27.874207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:27.874207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 274/550] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:27.874207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c203131-11de-409b-a500-3801812370d2 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:27.874207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c203131-11de-409b-a500-3801812370d2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:27.874557 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c203131-11de-409b-a500-3801812370d2 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:27.879580 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 275/551] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:27.879580 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c203131-11de-409b-a500-3801812370d2 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:27.889886 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2fda4-c850-443d-a6aa-4851225a4d8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:27.892234 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf2fda4-c850-443d-a6aa-4851225a4d8d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:27.913092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-cdf2fda4-c850-443d-a6aa-4851225a4d8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:27.913092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:27.913092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:27.913092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:27.913092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:27.913092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:27.913092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:27.913092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:27.913092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:27.913092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:27.913092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:27.913092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:27.913092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:27.913092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:27.913092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:27.913092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:27.914087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:27.914087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:27.914087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:27.914087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:27.914087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:27.914087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:27.914087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:27.914087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:27.914087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:27.914087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:27.914087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:27.914087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:27.914087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:27.914087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:27.914087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:27.914087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:27.914087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:27.915121 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:27.915121 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:27.915121 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:27.915802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 277/552] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:27.917457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844dae16-9ef5-428f-a43a-5ef947789689 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:27.917457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844dae16-9ef5-428f-a43a-5ef947789689 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:27.917630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844dae16-9ef5-428f-a43a-5ef947789689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:27.948167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-844dae16-9ef5-428f-a43a-5ef947789689 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:27.949413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-844dae16-9ef5-428f-a43a-5ef947789689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:27.959756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:28.016448 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c203131-11de-409b-a500-3801812370d2 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:28.042556 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 278/553] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:28.043734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844dae16-9ef5-428f-a43a-5ef947789689 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:28.061930 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:28.081123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ace908-13ab-4e97-9cd4-2e56de2bfa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:28.082825 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ace908-13ab-4e97-9cd4-2e56de2bfa86 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:28.083311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ace908-13ab-4e97-9cd4-2e56de2bfa86 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:28.085687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ace908-13ab-4e97-9cd4-2e56de2bfa86 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:28.086580 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ace908-13ab-4e97-9cd4-2e56de2bfa86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:28.087116 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ace908-13ab-4e97-9cd4-2e56de2bfa86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:28.088760 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ace908-13ab-4e97-9cd4-2e56de2bfa86 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:28.111589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 276/554] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:28.115125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebef87-1d31-4801-8270-5712fd36f1a5 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:28.116318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebef87-1d31-4801-8270-5712fd36f1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:28.116795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebef87-1d31-4801-8270-5712fd36f1a5 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:28.119889 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 277/555] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:28.120631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebef87-1d31-4801-8270-5712fd36f1a5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:28.195280 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844dae16-9ef5-428f-a43a-5ef947789689 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:28.241281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fe167-92f1-47e3-96fb-5270c9c1bf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:28.241908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fe167-92f1-47e3-96fb-5270c9c1bf51 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:28.242233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fe167-92f1-47e3-96fb-5270c9c1bf51 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:28.242511 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fe167-92f1-47e3-96fb-5270c9c1bf51 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:28.243211 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fe167-92f1-47e3-96fb-5270c9c1bf51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:28.244101 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fe167-92f1-47e3-96fb-5270c9c1bf51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:28.246430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fe167-92f1-47e3-96fb-5270c9c1bf51 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:28.258648 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebef87-1d31-4801-8270-5712fd36f1a5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:28.263321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 279/556] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:28.264660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70cf09-1d0a-46c4-9905-b5c7e0f82e04 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:28.264953 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70cf09-1d0a-46c4-9905-b5c7e0f82e04 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:28.265232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70cf09-1d0a-46c4-9905-b5c7e0f82e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:28.285050 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:28.291501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-1a70cf09-1d0a-46c4-9905-b5c7e0f82e04 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:28.293017 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1a70cf09-1d0a-46c4-9905-b5c7e0f82e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:28.301978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34e918-b526-45e9-ba4d-fc902f6be2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:28.302944 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34e918-b526-45e9-ba4d-fc902f6be2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:28.303489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34e918-b526-45e9-ba4d-fc902f6be2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:28.303964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34e918-b526-45e9-ba4d-fc902f6be2f7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:28.312399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34e918-b526-45e9-ba4d-fc902f6be2f7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:28.314315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34e918-b526-45e9-ba4d-fc902f6be2f7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:28.326782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-9a34e918-b526-45e9-ba4d-fc902f6be2f7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:12:28.326782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:28.326782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:28.326782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:28.326782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:28.326782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:28.326782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:28.326782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:28.326782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:28.326782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:28.326782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:28.326782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:28.326782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:28.326782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:28.326782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:28.326782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:28.327733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:28.327733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:28.327733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:28.327733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:28.327733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:28.327733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:28.327733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:28.327733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:28.327733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:28.327733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:28.327733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:28.327733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:28.327733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:28.327733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:28.327733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:28.327733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:28.327733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:28.327733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:28.328664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:28.328664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:28.328664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:28.328664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:28.328664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:28.328664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:28.328664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:28.328664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:28.328664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:12:28.328664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:28.330824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 278/557] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:12:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:28.331777 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34e918-b526-45e9-ba4d-fc902f6be2f7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:28.365121 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:28.378497 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 280/558] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:28.378497 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70cf09-1d0a-46c4-9905-b5c7e0f82e04 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:28.445596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34e918-b526-45e9-ba4d-fc902f6be2f7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:28.480832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70cf09-1d0a-46c4-9905-b5c7e0f82e04 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:28.484030 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffb52d-0bb2-4c3f-ae92-319c7e2e75fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:28.484817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffb52d-0bb2-4c3f-ae92-319c7e2e75fe None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:28.485236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffb52d-0bb2-4c3f-ae92-319c7e2e75fe None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:28.485666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffb52d-0bb2-4c3f-ae92-319c7e2e75fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:28.494655 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffb52d-0bb2-4c3f-ae92-319c7e2e75fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:28.496496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffb52d-0bb2-4c3f-ae92-319c7e2e75fe None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:28.508700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-49ffb52d-0bb2-4c3f-ae92-319c7e2e75fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:12:28.508700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:28.508700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:28.508700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:28.508700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:28.508700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:28.508700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:28.508700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:28.508700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:28.508700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:28.508700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:28.508700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:28.508700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:28.508700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:28.508700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:28.508700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:28.510555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:28.510555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:28.510555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:28.510555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:28.510555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:28.510555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:28.510555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:28.510555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:28.510555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:28.510555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:28.510555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:28.510555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:28.510555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:28.510555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:28.510555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:28.510555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:28.510555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:28.510555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:28.511515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:28.511515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:28.511515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:28.511515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:28.511515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:28.511515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:28.511515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:28.511515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:28.511515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:12:28.511515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:28.513403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 279/559] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 23 16:12:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:28.514470 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffb52d-0bb2-4c3f-ae92-319c7e2e75fe None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:28.522641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ac522-4a46-4058-b9da-3816069e8308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:28.523285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ac522-4a46-4058-b9da-3816069e8308 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:28.523577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ac522-4a46-4058-b9da-3816069e8308 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:28.524052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ac522-4a46-4058-b9da-3816069e8308 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:28.536902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ac522-4a46-4058-b9da-3816069e8308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:28.542984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-313ac522-4a46-4058-b9da-3816069e8308 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:28.542984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:28.542984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:28.542984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:28.542984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:28.542984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:28.542984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:28.542984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:28.542984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:28.542984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:28.542984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:28.542984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:28.542984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:28.542984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:28.542984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:28.542984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:28.544105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:28.544105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:28.544105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:28.544105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:28.544105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:28.544105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:28.544105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:28.544105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:28.544105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:28.544105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:28.544105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:28.544105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:28.544105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:28.544105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:28.544105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:28.544105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:28.545034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:28.545034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:28.545034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:28.545034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:28.545034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:28.545034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:28.545034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:28.545034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:28.545034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:28.545034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:28.545034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:28.545034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:28.548962 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 281/560] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:28.550144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ac522-4a46-4058-b9da-3816069e8308 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:28.569219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:28.617854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:28.656650 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffb52d-0bb2-4c3f-ae92-319c7e2e75fe None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:28.670749 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ac522-4a46-4058-b9da-3816069e8308 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:28.695998 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3f1e8-06f8-4d4f-87cd-e70947d5c538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:28.696736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3f1e8-06f8-4d4f-87cd-e70947d5c538 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:28.697140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3f1e8-06f8-4d4f-87cd-e70947d5c538 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:28.697410 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3f1e8-06f8-4d4f-87cd-e70947d5c538 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:28.698208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3f1e8-06f8-4d4f-87cd-e70947d5c538 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:28.698493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3f1e8-06f8-4d4f-87cd-e70947d5c538 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:28.699950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3f1e8-06f8-4d4f-87cd-e70947d5c538 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:28.708993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612a7d9-1bb1-4316-aa74-34478ba0c5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:28.709606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612a7d9-1bb1-4316-aa74-34478ba0c5f4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:28.709895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612a7d9-1bb1-4316-aa74-34478ba0c5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:28.710203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612a7d9-1bb1-4316-aa74-34478ba0c5f4 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:28.710937 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612a7d9-1bb1-4316-aa74-34478ba0c5f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:28.711246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612a7d9-1bb1-4316-aa74-34478ba0c5f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:28.712737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612a7d9-1bb1-4316-aa74-34478ba0c5f4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:28.721781 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 280/561] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 23 16:12:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:28.721781 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3f1e8-06f8-4d4f-87cd-e70947d5c538 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:28.732173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 282/562] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 23 16:12:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:28.733103 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612a7d9-1bb1-4316-aa74-34478ba0c5f4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:28.826325 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:28.830415 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3f1e8-06f8-4d4f-87cd-e70947d5c538 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:28.841857 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612a7d9-1bb1-4316-aa74-34478ba0c5f4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:28.856102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:28.864757 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc36eac-7063-431e-b49d-ed817bd7bffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:28.865363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc36eac-7063-431e-b49d-ed817bd7bffd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:28.865645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc36eac-7063-431e-b49d-ed817bd7bffd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:28.865919 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc36eac-7063-431e-b49d-ed817bd7bffd None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:28.866667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc36eac-7063-431e-b49d-ed817bd7bffd None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:28.866972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc36eac-7063-431e-b49d-ed817bd7bffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:28.868372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc36eac-7063-431e-b49d-ed817bd7bffd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:28.876123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 281/563] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:28.876601 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff436199-ff0d-48f4-9a4b-63a83538aa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:28.876905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc36eac-7063-431e-b49d-ed817bd7bffd None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:28.877228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff436199-ff0d-48f4-9a4b-63a83538aa2d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:28.877510 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff436199-ff0d-48f4-9a4b-63a83538aa2d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:28.877781 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff436199-ff0d-48f4-9a4b-63a83538aa2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:28.891412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff436199-ff0d-48f4-9a4b-63a83538aa2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:28.896146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-ff436199-ff0d-48f4-9a4b-63a83538aa2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:28.896146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:28.896146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:28.896146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:28.896146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:28.896146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:28.896146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:28.896146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:28.896146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:28.896146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:28.896146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:28.896146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:28.896146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:28.896146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:28.896146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:28.896146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:28.897038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:28.897038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:28.897038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:28.897038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:28.897038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:28.897038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:28.897038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:28.897038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:28.897038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:28.897038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:28.897038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:28.897038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:28.897038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:28.897038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:28.897038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:28.897038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:28.897868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:28.897868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:28.897868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:28.897868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:28.897868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:28.897868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:28.897868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:28.897868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:28.897868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:28.897868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:28.897868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:28.897868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:28.897868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 283/564] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:28.898599 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff436199-ff0d-48f4-9a4b-63a83538aa2d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:28.984926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc36eac-7063-431e-b49d-ed817bd7bffd None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:29.004909 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff436199-ff0d-48f4-9a4b-63a83538aa2d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:29.020203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad524a8d-d3d1-491e-af89-add202652084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:29.020809 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad524a8d-d3d1-491e-af89-add202652084 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:29.021087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad524a8d-d3d1-491e-af89-add202652084 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:29.021358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad524a8d-d3d1-491e-af89-add202652084 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:29.039614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467d832-7126-4b71-b409-5274ebfebef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:29.040234 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467d832-7126-4b71-b409-5274ebfebef2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:29.040566 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467d832-7126-4b71-b409-5274ebfebef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:29.040837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467d832-7126-4b71-b409-5274ebfebef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:29.048457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:29.051383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467d832-7126-4b71-b409-5274ebfebef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:29.052862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467d832-7126-4b71-b409-5274ebfebef2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:29.067729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-a467d832-7126-4b71-b409-5274ebfebef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:29.067729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:29.067729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:29.067729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:29.067729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:29.067729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:29.067729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:29.067729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:29.067729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:29.067729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:29.067729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:29.067729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:29.067729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:29.067729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:29.067729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:29.067729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:29.068681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:29.068681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:29.068681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:29.068681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:29.068681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:29.068681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:29.068681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:29.068681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:29.068681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:29.068681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:29.068681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:29.068681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:29.068681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:29.068681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:29.068681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:29.068681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:29.068681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:29.069541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:29.069541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:29.069541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:29.074199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 284/565] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:29.075623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd43e93-ccbb-4d46-8513-9bfd4ce1a600 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:29.075907 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd43e93-ccbb-4d46-8513-9bfd4ce1a600 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:29.076177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd43e93-ccbb-4d46-8513-9bfd4ce1a600 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:29.077481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 285/566] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:29.078133 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd43e93-ccbb-4d46-8513-9bfd4ce1a600 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:29.089995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad524a8d-d3d1-491e-af89-add202652084 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:29.091471 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad524a8d-d3d1-491e-af89-add202652084 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:29.107242 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:29.184001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd43e93-ccbb-4d46-8513-9bfd4ce1a600 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:29.195798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 282/567] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:12:29.196728 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad524a8d-d3d1-491e-af89-add202652084 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:29.218647 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8fcab-7d96-4bd5-9287-87c813a8cb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:29.219271 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8fcab-7d96-4bd5-9287-87c813a8cb45 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:29.219555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8fcab-7d96-4bd5-9287-87c813a8cb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:29.219836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8fcab-7d96-4bd5-9287-87c813a8cb45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:29.231025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8fcab-7d96-4bd5-9287-87c813a8cb45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:29.232469 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8fcab-7d96-4bd5-9287-87c813a8cb45 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:29.247318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-b2b8fcab-7d96-4bd5-9287-87c813a8cb45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:29.247318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:29.247318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:29.247318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:29.247318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:29.247318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:29.247318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:29.247318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:29.247318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:29.247318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:29.247318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:29.247318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:29.247318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:29.247318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:29.247318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:29.247318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:29.248426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:29.248426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:29.248426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:29.248426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:29.248426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:29.248426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:29.248426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:29.248426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:29.248426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:29.248426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:29.248426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:29.248426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:29.248426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:29.248426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:29.248426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:29.248426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:29.248426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:29.249295 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:29.249295 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:29.249295 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:29.249295 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 286/568] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:29.249295 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8fcab-7d96-4bd5-9287-87c813a8cb45 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:29.258157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:29.299732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad524a8d-d3d1-491e-af89-add202652084 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:29.329355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:29.333896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a982237-bf71-4abc-868e-0baf38e110ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:29.334533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a982237-bf71-4abc-868e-0baf38e110ac None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:29.334818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a982237-bf71-4abc-868e-0baf38e110ac None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:29.335087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a982237-bf71-4abc-868e-0baf38e110ac None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:29.335744 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a982237-bf71-4abc-868e-0baf38e110ac None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:29.336048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a982237-bf71-4abc-868e-0baf38e110ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:29.337526 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a982237-bf71-4abc-868e-0baf38e110ac None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:29.345930 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 283/569] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:29.347167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db37c-cfef-4164-894d-edf1142841c1 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:29.347461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db37c-cfef-4164-894d-edf1142841c1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:29.347732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db37c-cfef-4164-894d-edf1142841c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:29.361554 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8fcab-7d96-4bd5-9287-87c813a8cb45 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:29.365764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b33db37c-cfef-4164-894d-edf1142841c1 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:29.366985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b33db37c-cfef-4164-894d-edf1142841c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:29.395425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fe2de-ed05-455e-a982-f07073e54b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:29.396033 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fe2de-ed05-455e-a982-f07073e54b51 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:29.396316 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fe2de-ed05-455e-a982-f07073e54b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:29.396590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fe2de-ed05-455e-a982-f07073e54b51 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:29.397238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fe2de-ed05-455e-a982-f07073e54b51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:29.397539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fe2de-ed05-455e-a982-f07073e54b51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:29.398939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fe2de-ed05-455e-a982-f07073e54b51 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:29.410823 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 287/570] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:29.411619 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fe2de-ed05-455e-a982-f07073e54b51 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:29.434051 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 284/571] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:29.434906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33db37c-cfef-4164-894d-edf1142841c1 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:29.501941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:29.519582 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fe2de-ed05-455e-a982-f07073e54b51 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:29.552495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33db37c-cfef-4164-894d-edf1142841c1 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:29.563651 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0328e-24ca-4411-a96b-225af765c794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:29.564284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0328e-24ca-4411-a96b-225af765c794 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:29.565030 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0328e-24ca-4411-a96b-225af765c794 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:29.565311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0328e-24ca-4411-a96b-225af765c794 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:29.573794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:29.579443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0328e-24ca-4411-a96b-225af765c794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:29.581021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0328e-24ca-4411-a96b-225af765c794 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:29.593707 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbb7c8-46bd-4766-a685-277fa373c725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:29.594349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbb7c8-46bd-4766-a685-277fa373c725 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:29.594636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbb7c8-46bd-4766-a685-277fa373c725 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:29.594914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbb7c8-46bd-4766-a685-277fa373c725 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:29.595564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbb7c8-46bd-4766-a685-277fa373c725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:29.595884 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbb7c8-46bd-4766-a685-277fa373c725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:29.597236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbb7c8-46bd-4766-a685-277fa373c725 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:29.598817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-38a0328e-24ca-4411-a96b-225af765c794 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:29.598817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:29.598817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:29.598817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:29.598817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:29.598817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:29.598817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:29.598817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:29.598817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:29.598817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:29.598817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:29.598817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:29.598817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:29.598817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:29.598817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:29.598817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:29.599727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:29.599727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:29.599727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:29.599727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:29.599727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:29.599727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:29.599727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:29.599727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:29.599727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:29.599727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:29.599727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:29.599727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:29.599727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:29.599727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:29.599727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:29.599727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:29.599727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:29.600684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:29.600684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:29.600684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:29.600684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 288/572] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:29.600684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0328e-24ca-4411-a96b-225af765c794 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:29.618648 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 285/573] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:29.618648 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbb7c8-46bd-4766-a685-277fa373c725 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:29.712730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0328e-24ca-4411-a96b-225af765c794 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:29.725304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbb7c8-46bd-4766-a685-277fa373c725 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:29.738557 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:29.748032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e03f56-c764-4f5a-af61-6ceec5427be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:29.748658 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e03f56-c764-4f5a-af61-6ceec5427be5 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:29.748992 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e03f56-c764-4f5a-af61-6ceec5427be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:29.749265 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e03f56-c764-4f5a-af61-6ceec5427be5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:29.759435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e03f56-c764-4f5a-af61-6ceec5427be5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:29.759884 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31500a-2b92-4d97-9c3a-e97a5eeeb3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:29.760504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31500a-2b92-4d97-9c3a-e97a5eeeb3de None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:29.760784 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31500a-2b92-4d97-9c3a-e97a5eeeb3de None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:29.761057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31500a-2b92-4d97-9c3a-e97a5eeeb3de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:29.761154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e03f56-c764-4f5a-af61-6ceec5427be5 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:29.767546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31500a-2b92-4d97-9c3a-e97a5eeeb3de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:29.768953 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31500a-2b92-4d97-9c3a-e97a5eeeb3de None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:29.774636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-a7e03f56-c764-4f5a-af61-6ceec5427be5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:29.774636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:29.774636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:29.774636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:29.774636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:29.774636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:29.774636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:29.774636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:29.774636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:29.774636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:29.774636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:29.774636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:29.774636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:29.774636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:29.774636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:29.774636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:29.776443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:29.776443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:29.776443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:29.776443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:29.776443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:29.776443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:29.776443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:29.776443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:29.776443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:29.776443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:29.776443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:29.776443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:29.776443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:29.776443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:29.776443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:29.776443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:29.776443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:29.777328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:29.777328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:29.777328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:29.777328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 289/574] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:29.777558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e03f56-c764-4f5a-af61-6ceec5427be5 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:29.782724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-7c31500a-2b92-4d97-9c3a-e97a5eeeb3de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:29.782724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:29.782724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:29.782724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:29.782724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:29.782724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:29.782724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:29.782724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:29.782724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:29.782724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:29.782724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:29.782724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:29.782724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:29.782724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:29.782724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:29.784126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:29.784126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:29.784126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:29.784126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:29.784126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:29.784126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:29.784126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:29.784126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:29.784126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:29.784126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:29.784126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:29.784126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:29.784126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:29.784126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:29.784126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:29.784126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:29.784126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:29.785001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:29.785001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:29.785001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:29.785001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:29.785001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:29.785001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:29.785001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:29.785001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:29.785001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 286/575] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:29.785479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31500a-2b92-4d97-9c3a-e97a5eeeb3de None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:29.820501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:29.878996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e03f56-c764-4f5a-af61-6ceec5427be5 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:29.883148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31500a-2b92-4d97-9c3a-e97a5eeeb3de None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:29.913180 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cec98-9e4a-404a-a4c7-2a681908c686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:29.913784 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cec98-9e4a-404a-a4c7-2a681908c686 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:29.914088 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cec98-9e4a-404a-a4c7-2a681908c686 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:29.914368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cec98-9e4a-404a-a4c7-2a681908c686 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:29.915012 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cec98-9e4a-404a-a4c7-2a681908c686 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:29.915907 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cec98-9e4a-404a-a4c7-2a681908c686 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:29.917384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a42ec2-7956-4295-ac45-8d07edfd770d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:29.917521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cec98-9e4a-404a-a4c7-2a681908c686 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:29.917998 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42ec2-7956-4295-ac45-8d07edfd770d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:29.918308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42ec2-7956-4295-ac45-8d07edfd770d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:29.918587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a42ec2-7956-4295-ac45-8d07edfd770d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:29.925853 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a42ec2-7956-4295-ac45-8d07edfd770d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:29.927328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a42ec2-7956-4295-ac45-8d07edfd770d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:29.929035 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 290/576] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:29.929833 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cec98-9e4a-404a-a4c7-2a681908c686 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:29.938340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-19a42ec2-7956-4295-ac45-8d07edfd770d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:12:29.938340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:29.938340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:29.938340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:29.938340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:29.938340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:29.938340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:29.938340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:29.938340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:29.938340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:29.938340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:29.938340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:29.938340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:29.938340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:29.938340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:29.938340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:29.939335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:29.939335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:29.939335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:29.939335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:29.939335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:29.939335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:29.939335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:29.939335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:29.939335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:29.939335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:29.939335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:29.939335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:29.939335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:29.939335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:29.939335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:29.939335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:29.939335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:29.939335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:29.940276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:29.940276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:29.940276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:29.940276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:29.940276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:29.940276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:29.940276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:29.940276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:29.940276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:12:29.940276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:29.940276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 287/577] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:29.940276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a42ec2-7956-4295-ac45-8d07edfd770d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:29.971394 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:30.035671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cec98-9e4a-404a-a4c7-2a681908c686 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:30.037203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:30.042205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a42ec2-7956-4295-ac45-8d07edfd770d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:30.071098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff8825-9d11-47b8-a5b7-40cfcbb850c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:30.071780 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff8825-9d11-47b8-a5b7-40cfcbb850c1 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:30.072593 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff8825-9d11-47b8-a5b7-40cfcbb850c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:30.072827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff8825-9d11-47b8-a5b7-40cfcbb850c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:30.075980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9eeb5-043b-4237-aa17-bd9a7d37bd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:30.076609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9eeb5-043b-4237-aa17-bd9a7d37bd63 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:30.076888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9eeb5-043b-4237-aa17-bd9a7d37bd63 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:30.077160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9eeb5-043b-4237-aa17-bd9a7d37bd63 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:30.077796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9eeb5-043b-4237-aa17-bd9a7d37bd63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:30.078131 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9eeb5-043b-4237-aa17-bd9a7d37bd63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:30.079474 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9eeb5-043b-4237-aa17-bd9a7d37bd63 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:30.082867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff8825-9d11-47b8-a5b7-40cfcbb850c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:30.087702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-22ff8825-9d11-47b8-a5b7-40cfcbb850c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:30.087702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:30.087702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:30.087702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:30.087702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:30.087702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:30.087702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:30.087702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:30.087702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:30.087702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:30.087702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:30.087702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:30.087702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:30.087702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:30.087702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:30.087702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:30.088704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:30.088704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:30.088704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:30.088704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:30.088704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:30.088704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:30.088704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:30.088704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:30.088704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:30.088704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:30.088704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:30.088704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:30.088704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:30.088704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:30.088704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:30.088704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:30.089544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:30.089544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:30.089544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:30.089544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:30.089544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:30.089544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:30.089544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:30.089544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:30.089544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:30.089544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:30.089544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:30.089544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:30.089544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 291/578] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:30.090293 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff8825-9d11-47b8-a5b7-40cfcbb850c1 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:30.093538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 288/579] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:30.094585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9eeb5-043b-4237-aa17-bd9a7d37bd63 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:30.187137 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:30.195899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff8825-9d11-47b8-a5b7-40cfcbb850c1 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:30.196428 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9eeb5-043b-4237-aa17-bd9a7d37bd63 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:30.229410 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5e320-cc0c-4b43-8298-f2091607e3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:30.230029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5e320-cc0c-4b43-8298-f2091607e3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:30.230335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5e320-cc0c-4b43-8298-f2091607e3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:30.230437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aec2bf-47aa-4a58-aa6d-607381f78c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:30.230607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5e320-cc0c-4b43-8298-f2091607e3d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:30.231021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aec2bf-47aa-4a58-aa6d-607381f78c6f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:30.231298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aec2bf-47aa-4a58-aa6d-607381f78c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:30.231565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aec2bf-47aa-4a58-aa6d-607381f78c6f None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:30.232244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aec2bf-47aa-4a58-aa6d-607381f78c6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:30.232546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aec2bf-47aa-4a58-aa6d-607381f78c6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:30.233964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aec2bf-47aa-4a58-aa6d-607381f78c6f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:30.237307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5e320-cc0c-4b43-8298-f2091607e3d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:30.238737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5e320-cc0c-4b43-8298-f2091607e3d3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:30.246521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 292/580] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:30.247310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aec2bf-47aa-4a58-aa6d-607381f78c6f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:30.250290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-dbe5e320-cc0c-4b43-8298-f2091607e3d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:30.250290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:30.250290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:30.250290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:30.250290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:30.250290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:30.250290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:30.250290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:30.250290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:30.250290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:30.250290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:30.250290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:30.250290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:30.250290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:30.250290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:30.251363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:30.251363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:30.251363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:30.251363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:30.251363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:30.251363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:30.251363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:30.251363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:30.251363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:30.251363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:30.251363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:30.251363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:30.251363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:30.251363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:30.251363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:30.251363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:30.251363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:30.252569 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:30.252569 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:30.252569 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:30.252569 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:30.252569 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:30.252569 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:30.252569 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:30.252569 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:30.254393 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 289/581] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:30.255035 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5e320-cc0c-4b43-8298-f2091607e3d3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:30.274278 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:30.351842 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aec2bf-47aa-4a58-aa6d-607381f78c6f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:30.352086 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5e320-cc0c-4b43-8298-f2091607e3d3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:30.385411 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28550f99-7382-4147-a228-a2863626c92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:30.386026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28550f99-7382-4147-a228-a2863626c92d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:30.386323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54436cfb-680f-4595-aa6a-104ddc4d8d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:30.386457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28550f99-7382-4147-a228-a2863626c92d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:30.386591 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28550f99-7382-4147-a228-a2863626c92d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:30.386915 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54436cfb-680f-4595-aa6a-104ddc4d8d26 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:30.387193 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54436cfb-680f-4595-aa6a-104ddc4d8d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:30.387465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54436cfb-680f-4595-aa6a-104ddc4d8d26 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:30.388175 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54436cfb-680f-4595-aa6a-104ddc4d8d26 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:30.388478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54436cfb-680f-4595-aa6a-104ddc4d8d26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:30.389891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54436cfb-680f-4595-aa6a-104ddc4d8d26 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:30.394584 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28550f99-7382-4147-a228-a2863626c92d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:30.396007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28550f99-7382-4147-a228-a2863626c92d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:30.407289 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 293/582] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 23 16:12:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:30.408085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54436cfb-680f-4595-aa6a-104ddc4d8d26 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:30.408501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-28550f99-7382-4147-a228-a2863626c92d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:12:30.408501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:30.408501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:30.408501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:30.408501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:30.408501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:30.408501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:30.408501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:30.408501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:30.408501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:30.408501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:30.408501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:30.408501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:30.408501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:30.408501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:30.408501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:30.409682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:30.409682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:30.409682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:30.409682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:30.409682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:30.409682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:30.409682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:30.409682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:30.409682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:30.409682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:30.409682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:30.409682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:30.409682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:30.409682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:30.409682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:30.409682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:30.409682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:30.409682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:30.410675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:30.410675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:30.410675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:30.410675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:30.410675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:30.410675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:30.410675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:30.410675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:30.410675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:12:30.410675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:30.410675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 290/583] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:30.412718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28550f99-7382-4147-a228-a2863626c92d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:30.427625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:30.492607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:30.512512 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54436cfb-680f-4595-aa6a-104ddc4d8d26 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:30.513230 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28550f99-7382-4147-a228-a2863626c92d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:30.546948 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371a563-bb16-496c-bbaf-debf580a8a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:30.547487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60982883-6848-4e59-9eca-6cb7a3864d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:30.547617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371a563-bb16-496c-bbaf-debf580a8a17 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:30.547811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371a563-bb16-496c-bbaf-debf580a8a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:30.547940 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60982883-6848-4e59-9eca-6cb7a3864d52 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:30.548079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1371a563-bb16-496c-bbaf-debf580a8a17 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:30.548220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60982883-6848-4e59-9eca-6cb7a3864d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:30.548492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60982883-6848-4e59-9eca-6cb7a3864d52 None admin] PATH_INFO: `/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/767ca33ca8e244f8a0cc773e3b6abefb/roles/bbf63b75406649a3b653308ecb75062d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:30.548727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371a563-bb16-496c-bbaf-debf580a8a17 None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:30.549027 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371a563-bb16-496c-bbaf-debf580a8a17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:30.550413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1371a563-bb16-496c-bbaf-debf580a8a17 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:30.558824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 294/584] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:30.559608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371a563-bb16-496c-bbaf-debf580a8a17 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:30.568451 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60982883-6848-4e59-9eca-6cb7a3864d52 None admin] RBAC: Authorizing `identity:create_grant(project_id=15a0439c9dd3406f81e2740fe775782b, user_id=767ca33ca8e244f8a0cc773e3b6abefb, role_id=bbf63b75406649a3b653308ecb75062d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:30.569868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60982883-6848-4e59-9eca-6cb7a3864d52 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:30.583400 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 291/585] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:12:30 2022] PUT /identity/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/767ca33ca8e244f8a0cc773e3b6abefb/roles/bbf63b75406649a3b653308ecb75062d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:12:30.584188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60982883-6848-4e59-9eca-6cb7a3864d52 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:30.660023 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:30.688252 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1371a563-bb16-496c-bbaf-debf580a8a17 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:30.706967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60982883-6848-4e59-9eca-6cb7a3864d52 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:30.729404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead8f4e-e7a3-42bb-a840-95b0dadb9389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:30.730142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead8f4e-e7a3-42bb-a840-95b0dadb9389 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:30.730487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead8f4e-e7a3-42bb-a840-95b0dadb9389 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:30.730761 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead8f4e-e7a3-42bb-a840-95b0dadb9389 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:30.731585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead8f4e-e7a3-42bb-a840-95b0dadb9389 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:30.731984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead8f4e-e7a3-42bb-a840-95b0dadb9389 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:30.733586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead8f4e-e7a3-42bb-a840-95b0dadb9389 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:30.748692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 295/586] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:30.749462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead8f4e-e7a3-42bb-a840-95b0dadb9389 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:30.752144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:30.762406 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1e570-36ff-475a-8f41-6890c8a0182e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:30.763046 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1e570-36ff-475a-8f41-6890c8a0182e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:30.763381 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1e570-36ff-475a-8f41-6890c8a0182e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:30.763656 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1e570-36ff-475a-8f41-6890c8a0182e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:30.774446 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1e570-36ff-475a-8f41-6890c8a0182e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:30.776867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1e570-36ff-475a-8f41-6890c8a0182e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:30.793589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-eab1e570-36ff-475a-8f41-6890c8a0182e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:30.793589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:30.793589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:30.793589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:30.793589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:30.793589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:30.793589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:30.793589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:30.793589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:30.793589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:30.793589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:30.793589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:30.793589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:30.793589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:30.793589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:30.793589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:30.794609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:30.794609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:30.794609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:30.794609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:30.794609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:30.794609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:30.794609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:30.794609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:30.794609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:30.794609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:30.794609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:30.794609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:30.794609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:30.794609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:30.794609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:30.794609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:30.794609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:30.795527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:30.795527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:30.795527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:30.795527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 292/587] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:30.796282 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1e570-36ff-475a-8f41-6890c8a0182e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:30.857173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead8f4e-e7a3-42bb-a840-95b0dadb9389 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:30.893630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36da36-e104-4d07-bc49-4e4a0e07e101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:30.894279 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36da36-e104-4d07-bc49-4e4a0e07e101 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:30.894562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36da36-e104-4d07-bc49-4e4a0e07e101 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:30.894838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36da36-e104-4d07-bc49-4e4a0e07e101 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:30.895573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36da36-e104-4d07-bc49-4e4a0e07e101 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:30.895880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36da36-e104-4d07-bc49-4e4a0e07e101 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:30.897308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36da36-e104-4d07-bc49-4e4a0e07e101 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:30.914793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1e570-36ff-475a-8f41-6890c8a0182e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:30.917811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 296/588] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 23 16:12:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:30.918762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36da36-e104-4d07-bc49-4e4a0e07e101 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:30.938544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:30.961644 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d3317-cabd-43a4-998f-5431104753d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:30.962930 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d3317-cabd-43a4-998f-5431104753d1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:30.963507 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d3317-cabd-43a4-998f-5431104753d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:30.963936 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d3317-cabd-43a4-998f-5431104753d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:30.975411 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d3317-cabd-43a4-998f-5431104753d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:30.977253 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d3317-cabd-43a4-998f-5431104753d1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:30.989813 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:30.992567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-506d3317-cabd-43a4-998f-5431104753d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:30.992567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:30.992567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:30.992567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:30.992567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:30.992567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:30.992567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:30.992567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:30.992567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:30.992567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:30.992567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:30.992567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:30.992567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:30.992567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:30.992567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:30.992567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:30.994305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:30.994305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:30.994305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:30.994305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:30.994305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:30.994305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:30.994305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:30.994305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:30.994305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:30.994305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:30.994305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:30.994305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:30.994305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:30.994305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:30.994305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:30.994305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:30.994305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:31.000473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:31.000473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:31.000473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:31.000473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 293/589] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:31.000473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d3317-cabd-43a4-998f-5431104753d1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:31.044790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36da36-e104-4d07-bc49-4e4a0e07e101 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:31.082426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada57d17-aed0-4534-b565-960b3c0d990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:31.083163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada57d17-aed0-4534-b565-960b3c0d990d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:31.083526 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada57d17-aed0-4534-b565-960b3c0d990d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:31.083935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada57d17-aed0-4534-b565-960b3c0d990d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:31.084834 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada57d17-aed0-4534-b565-960b3c0d990d None admin] RBAC: Adding query filter params (role.id=bbf63b75406649a3b653308ecb75062d, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=e7fb290911bc4de887d04b71731f76b5) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:31.085201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada57d17-aed0-4534-b565-960b3c0d990d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:31.086722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada57d17-aed0-4534-b565-960b3c0d990d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:31.102578 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 297/590] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:12:30 2022] GET /identity/v3/role_assignments?user.id=e7fb290911bc4de887d04b71731f76b5&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=bbf63b75406649a3b653308ecb75062d => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:31.104093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d3317-cabd-43a4-998f-5431104753d1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:31.104665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada57d17-aed0-4534-b565-960b3c0d990d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:31.143784 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c7af4-a844-4fe6-b728-97573ed209ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:31.144427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c7af4-a844-4fe6-b728-97573ed209ae None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:31.144769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c7af4-a844-4fe6-b728-97573ed209ae None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:31.145050 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c7af4-a844-4fe6-b728-97573ed209ae None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:31.145793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c7af4-a844-4fe6-b728-97573ed209ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:31.146140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c7af4-a844-4fe6-b728-97573ed209ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:31.147896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c7af4-a844-4fe6-b728-97573ed209ae None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:31.168996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 294/591] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:31.169997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c7af4-a844-4fe6-b728-97573ed209ae None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:31.203791 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:31.267416 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada57d17-aed0-4534-b565-960b3c0d990d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:31.299549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:31.309137 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c7af4-a844-4fe6-b728-97573ed209ae None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:31.314691 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561347e2-48fd-4903-8354-c6a6fee39fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:31.315328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561347e2-48fd-4903-8354-c6a6fee39fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:31.315605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561347e2-48fd-4903-8354-c6a6fee39fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:31.315921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561347e2-48fd-4903-8354-c6a6fee39fc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:31.331142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561347e2-48fd-4903-8354-c6a6fee39fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:31.333133 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561347e2-48fd-4903-8354-c6a6fee39fc9 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:31.354166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-561347e2-48fd-4903-8354-c6a6fee39fc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:31.354166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:31.354166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:31.354166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:31.354166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:31.354166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:31.354166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:31.354166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:31.354166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:31.354166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:31.354166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:31.354166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:31.354166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:31.354166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:31.354166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:31.354166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:31.355173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:31.355173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:31.355173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:31.355173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:31.355173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:31.355173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:31.355173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:31.355173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:31.355173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:31.355173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:31.355173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:31.355173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:31.355173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:31.355173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:31.355173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:31.355173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:31.355173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:31.356093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:31.356093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:31.356093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:31.357052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd5bb3-d698-441d-b8d9-90c7fc5b3b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:31.357907 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd5bb3-d698-441d-b8d9-90c7fc5b3b00 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:31.358416 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd5bb3-d698-441d-b8d9-90c7fc5b3b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:31.358866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd5bb3-d698-441d-b8d9-90c7fc5b3b00 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:31.359702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd5bb3-d698-441d-b8d9-90c7fc5b3b00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:31.359938 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 298/592] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:31.360363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd5bb3-d698-441d-b8d9-90c7fc5b3b00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:31.360839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561347e2-48fd-4903-8354-c6a6fee39fc9 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:31.362179 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd5bb3-d698-441d-b8d9-90c7fc5b3b00 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:31.376829 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 295/593] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:31.382320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd5bb3-d698-441d-b8d9-90c7fc5b3b00 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:31.473373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:31.482192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561347e2-48fd-4903-8354-c6a6fee39fc9 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:31.491133 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd5bb3-d698-441d-b8d9-90c7fc5b3b00 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:31.520829 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09db66-4119-4734-a237-47326a3bf74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:31.521384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09db66-4119-4734-a237-47326a3bf74a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:31.521666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09db66-4119-4734-a237-47326a3bf74a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:31.521941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09db66-4119-4734-a237-47326a3bf74a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:31.529505 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b0387-5463-4cce-bc31-17e8601c8784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:31.530537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09db66-4119-4734-a237-47326a3bf74a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:31.530961 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b0387-5463-4cce-bc31-17e8601c8784 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:31.531422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b0387-5463-4cce-bc31-17e8601c8784 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:31.531895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b0387-5463-4cce-bc31-17e8601c8784 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:31.532145 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09db66-4119-4734-a237-47326a3bf74a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:31.533190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b0387-5463-4cce-bc31-17e8601c8784 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:31.533949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b0387-5463-4cce-bc31-17e8601c8784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:31.535499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b0387-5463-4cce-bc31-17e8601c8784 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:31.545472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-fb09db66-4119-4734-a237-47326a3bf74a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:31.545472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:31.545472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:31.545472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:31.545472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:31.545472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:31.545472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:31.545472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:31.545472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:31.545472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:31.545472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:31.545472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:31.545472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:31.545472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:31.545472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:31.546625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:31.546625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:31.546625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:31.546625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:31.546625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:31.546625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:31.546625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:31.546625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:31.546625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:31.546625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:31.546625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:31.546625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:31.546625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:31.546625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:31.546625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:31.546625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:31.546625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:31.547972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:31.547972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:31.547972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:31.547972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:31.547972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:31.547972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:31.547972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:31.547972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:31.550935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 299/594] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:31.551841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09db66-4119-4734-a237-47326a3bf74a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:31.552233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 296/595] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:31.554512 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b0387-5463-4cce-bc31-17e8601c8784 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:31.594786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:31.664845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09db66-4119-4734-a237-47326a3bf74a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:31.672387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b0387-5463-4cce-bc31-17e8601c8784 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:31.702849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dea56-44ed-4289-8847-78f6e0091bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:31.703503 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dea56-44ed-4289-8847-78f6e0091bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:31.703782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dea56-44ed-4289-8847-78f6e0091bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:31.704054 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dea56-44ed-4289-8847-78f6e0091bd1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:31.713477 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537dea56-44ed-4289-8847-78f6e0091bd1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:31.715100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537dea56-44ed-4289-8847-78f6e0091bd1 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:31.716066 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a148b57-e0b5-4548-93b9-5ca61f24d1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:31.717004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a148b57-e0b5-4548-93b9-5ca61f24d1ff None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:31.717486 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a148b57-e0b5-4548-93b9-5ca61f24d1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:31.718007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a148b57-e0b5-4548-93b9-5ca61f24d1ff None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:31.718994 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a148b57-e0b5-4548-93b9-5ca61f24d1ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:31.719562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a148b57-e0b5-4548-93b9-5ca61f24d1ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:31.721240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a148b57-e0b5-4548-93b9-5ca61f24d1ff None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:31.726412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-537dea56-44ed-4289-8847-78f6e0091bd1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:12:31.726412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:31.726412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:31.726412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:31.726412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:31.726412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:31.726412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:31.726412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:31.726412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:31.726412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:31.726412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:31.726412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:31.726412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:31.726412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:31.726412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:31.726412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:31.727361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:31.727361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:31.727361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:31.727361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:31.727361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:31.727361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:31.727361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:31.727361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:31.727361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:31.727361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:31.727361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:31.727361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:31.727361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:31.727361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:31.727361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:31.727361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:31.727361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:31.727361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:31.729299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:31.729299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:31.729299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:31.729299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:31.729299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:31.729299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:31.729299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:31.729299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:31.729299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:12:31.729299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:31.732783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 300/596] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:31.733634 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dea56-44ed-4289-8847-78f6e0091bd1 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:31.738568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 297/597] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:31.744976 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a148b57-e0b5-4548-93b9-5ca61f24d1ff None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:31.755097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:31.835051 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:31.841893 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dea56-44ed-4289-8847-78f6e0091bd1 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:31.880416 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e3614-f14c-4aea-89a4-a04ab4ad0eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:31.880702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a148b57-e0b5-4548-93b9-5ca61f24d1ff None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:31.881286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e3614-f14c-4aea-89a4-a04ab4ad0eac None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:31.881661 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e3614-f14c-4aea-89a4-a04ab4ad0eac None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:31.882085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e3614-f14c-4aea-89a4-a04ab4ad0eac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:31.890234 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e3614-f14c-4aea-89a4-a04ab4ad0eac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:31.891721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e3614-f14c-4aea-89a4-a04ab4ad0eac None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:31.904248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-690e3614-f14c-4aea-89a4-a04ab4ad0eac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:31.904248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:31.904248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:31.904248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:31.904248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:31.904248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:31.904248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:31.904248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:31.904248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:31.904248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:31.904248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:31.904248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:31.904248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:31.904248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:31.904248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:31.905382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:31.905382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:31.905382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:31.905382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:31.905382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:31.905382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:31.905382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:31.905382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:31.905382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:31.905382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:31.905382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:31.905382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:31.905382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:31.905382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:31.905382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:31.905382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:31.905382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:31.906488 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:31.906488 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:31.906488 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:31.906488 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:31.906488 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:31.906488 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:31.906488 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:31.906488 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:31.912819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 301/598] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:31.913858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e3614-f14c-4aea-89a4-a04ab4ad0eac None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:31.923288 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1958fd4-a79d-4524-b7c1-03b43b100593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:31.924115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1958fd4-a79d-4524-b7c1-03b43b100593 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:31.925044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1958fd4-a79d-4524-b7c1-03b43b100593 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:31.925470 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1958fd4-a79d-4524-b7c1-03b43b100593 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:31.926375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1958fd4-a79d-4524-b7c1-03b43b100593 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:31.927291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1958fd4-a79d-4524-b7c1-03b43b100593 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:31.929303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1958fd4-a79d-4524-b7c1-03b43b100593 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:31.953225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 298/599] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 23 16:12:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:31.954414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1958fd4-a79d-4524-b7c1-03b43b100593 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:32.039982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e3614-f14c-4aea-89a4-a04ab4ad0eac None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:32.044574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:32.081167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ea704-6d27-4392-b848-fb6bf4f8c117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:32.082356 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ea704-6d27-4392-b848-fb6bf4f8c117 None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:32.082831 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ea704-6d27-4392-b848-fb6bf4f8c117 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:32.083314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ea704-6d27-4392-b848-fb6bf4f8c117 None admin] PATH_INFO: `/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/d3ddab91bbb24d119dd302024f458d35/roles/bbf63b75406649a3b653308ecb75062d` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:32.097322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1958fd4-a79d-4524-b7c1-03b43b100593 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:32.100246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ea704-6d27-4392-b848-fb6bf4f8c117 None admin] RBAC: Authorizing `identity:create_grant(project_id=15a0439c9dd3406f81e2740fe775782b, user_id=d3ddab91bbb24d119dd302024f458d35, role_id=bbf63b75406649a3b653308ecb75062d)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:32.101946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ea704-6d27-4392-b848-fb6bf4f8c117 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:32.116316 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 302/600] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:12:31 2022] PUT /identity/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/d3ddab91bbb24d119dd302024f458d35/roles/bbf63b75406649a3b653308ecb75062d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:12:32.117557 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ea704-6d27-4392-b848-fb6bf4f8c117 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:32.128448 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:32.148008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad414f1-0f40-4327-b137-14982eae6a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:32.149205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad414f1-0f40-4327-b137-14982eae6a2d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:32.150173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad414f1-0f40-4327-b137-14982eae6a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:32.151076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad414f1-0f40-4327-b137-14982eae6a2d None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:32.152015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad414f1-0f40-4327-b137-14982eae6a2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:32.152582 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad414f1-0f40-4327-b137-14982eae6a2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:32.154399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad414f1-0f40-4327-b137-14982eae6a2d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:32.182381 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 299/601] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:32.191216 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad414f1-0f40-4327-b137-14982eae6a2d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:32.252071 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ea704-6d27-4392-b848-fb6bf4f8c117 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:32.303187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f8588-0d58-45d4-9cdd-b10238aa19bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:32.304325 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f8588-0d58-45d4-9cdd-b10238aa19bf None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:32.304846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f8588-0d58-45d4-9cdd-b10238aa19bf None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:32.305357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f8588-0d58-45d4-9cdd-b10238aa19bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:32.333117 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f8588-0d58-45d4-9cdd-b10238aa19bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:32.335856 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f8588-0d58-45d4-9cdd-b10238aa19bf None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:32.356031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-718f8588-0d58-45d4-9cdd-b10238aa19bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:32.356031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:32.356031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:32.356031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:32.356031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:32.356031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:32.356031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:32.356031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:32.356031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:32.356031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:32.356031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:32.356031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:32.356031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:32.356031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:32.356031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:32.356031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:32.356989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:32.356989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:32.356989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:32.356989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:32.356989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:32.356989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:32.356989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:32.356989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:32.356989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:32.356989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:32.356989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:32.356989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:32.356989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:32.356989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:32.356989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:32.356989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:32.356989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:32.358157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:32.358157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:32.358157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:32.358157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 303/602] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:32.364393 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f8588-0d58-45d4-9cdd-b10238aa19bf None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:32.401420 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad414f1-0f40-4327-b137-14982eae6a2d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:32.436602 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:32.450921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:32.451482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cecff-2f2c-436b-83cb-7331c72cd3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:32.452503 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cecff-2f2c-436b-83cb-7331c72cd3ea None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:32.452990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cecff-2f2c-436b-83cb-7331c72cd3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:32.453273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cecff-2f2c-436b-83cb-7331c72cd3ea None admin] PATH_INFO: `/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/9eae00506f75402fbf972a8991ad0a68/roles/bbf63b75406649a3b653308ecb75062d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:32.477545 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787cecff-2f2c-436b-83cb-7331c72cd3ea None admin] RBAC: Authorizing `identity:create_grant(project_id=15a0439c9dd3406f81e2740fe775782b, user_id=9eae00506f75402fbf972a8991ad0a68, role_id=bbf63b75406649a3b653308ecb75062d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:32.479673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787cecff-2f2c-436b-83cb-7331c72cd3ea None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:32.485726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f8588-0d58-45d4-9cdd-b10238aa19bf None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:32.507724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 300/603] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:12:32 2022] PUT /identity/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/9eae00506f75402fbf972a8991ad0a68/roles/bbf63b75406649a3b653308ecb75062d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:12:32.537111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87c218-8744-4052-97e2-560618d77beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:32.537756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87c218-8744-4052-97e2-560618d77beb None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:32.538042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87c218-8744-4052-97e2-560618d77beb None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:32.538432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87c218-8744-4052-97e2-560618d77beb None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:32.539176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87c218-8744-4052-97e2-560618d77beb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:32.539549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87c218-8744-4052-97e2-560618d77beb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:32.541222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87c218-8744-4052-97e2-560618d77beb None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:32.556023 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 304/604] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:32.561614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cecff-2f2c-436b-83cb-7331c72cd3ea None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:32.694036 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cecff-2f2c-436b-83cb-7331c72cd3ea None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:32.732975 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee62476-90b8-43ea-ad9f-1642e04bbf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:32.733616 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee62476-90b8-43ea-ad9f-1642e04bbf48 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:32.733901 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee62476-90b8-43ea-ad9f-1642e04bbf48 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:32.734205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee62476-90b8-43ea-ad9f-1642e04bbf48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:32.738701 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee0920-254e-40a5-82bf-92386e7d5c38 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:32.738987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee0920-254e-40a5-82bf-92386e7d5c38 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:32.739268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee0920-254e-40a5-82bf-92386e7d5c38 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:32.740638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 305/605] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:32.746178 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee62476-90b8-43ea-ad9f-1642e04bbf48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:32.747718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee62476-90b8-43ea-ad9f-1642e04bbf48 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:32.755765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98357944-5261-41cb-88d1-72248c199377 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:32.756206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98357944-5261-41cb-88d1-72248c199377 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:32.756584 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98357944-5261-41cb-88d1-72248c199377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:32.761042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2ee62476-90b8-43ea-ad9f-1642e04bbf48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:32.761042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:32.761042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:32.761042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:32.761042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:32.761042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:32.761042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:32.761042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:32.761042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:32.761042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:32.761042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:32.761042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:32.761042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:32.761042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:32.761042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:32.761951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:32.761951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:32.761951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:32.761951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:32.761951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:32.761951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:32.761951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:32.761951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:32.761951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:32.761951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:32.761951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:32.761951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:32.761951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:32.761951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:32.761951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:32.761951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:32.761951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:32.762865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:32.762865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:32.762865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:32.762865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:32.762865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:32.762865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:32.762865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:32.762865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:32.762865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 301/606] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:32.768607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee62476-90b8-43ea-ad9f-1642e04bbf48 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:32.789764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-98357944-5261-41cb-88d1-72248c199377 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:32.791064 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-98357944-5261-41cb-88d1-72248c199377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:32.817237 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:32.884837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 306/607] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:32.903625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee62476-90b8-43ea-ad9f-1642e04bbf48 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:32.945256 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c77fee-f541-43f1-b9fc-cedd56f69b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:32.946000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c77fee-f541-43f1-b9fc-cedd56f69b5c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:32.946470 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c77fee-f541-43f1-b9fc-cedd56f69b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:32.946900 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c77fee-f541-43f1-b9fc-cedd56f69b5c None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:32.947960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c77fee-f541-43f1-b9fc-cedd56f69b5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:32.948373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c77fee-f541-43f1-b9fc-cedd56f69b5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:32.949936 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c77fee-f541-43f1-b9fc-cedd56f69b5c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:32.963998 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 302/608] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:32.973680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98357944-5261-41cb-88d1-72248c199377 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:33.064159 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:33.134599 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98357944-5261-41cb-88d1-72248c199377 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:33.172127 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5bffe-4627-4bd0-9722-ff2a3852779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:33.172779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5bffe-4627-4bd0-9722-ff2a3852779d None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:33.173056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5bffe-4627-4bd0-9722-ff2a3852779d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:33.173326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5bffe-4627-4bd0-9722-ff2a3852779d None admin] PATH_INFO: `/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/8ffa4002b4b24e6e9665dc349ad2f1b6/roles/bbf63b75406649a3b653308ecb75062d` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:33.191937 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5bffe-4627-4bd0-9722-ff2a3852779d None admin] RBAC: Authorizing `identity:create_grant(project_id=15a0439c9dd3406f81e2740fe775782b, user_id=8ffa4002b4b24e6e9665dc349ad2f1b6, role_id=bbf63b75406649a3b653308ecb75062d)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:33.193473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5bffe-4627-4bd0-9722-ff2a3852779d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:33.218533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 307/609] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:12:32 2022] PUT /identity/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/8ffa4002b4b24e6e9665dc349ad2f1b6/roles/bbf63b75406649a3b653308ecb75062d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:12:33.261881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c77fee-f541-43f1-b9fc-cedd56f69b5c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:33.392882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:33.403695 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c77fee-f541-43f1-b9fc-cedd56f69b5c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:33.449600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a8ced-b566-4a92-a654-63a65339490f None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:33.449880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a8ced-b566-4a92-a654-63a65339490f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:33.454247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a8ced-b566-4a92-a654-63a65339490f None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:33.454421 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801aef3-dea5-4294-b9ff-29ba205cfa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:33.455205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801aef3-dea5-4294-b9ff-29ba205cfa00 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:33.455630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801aef3-dea5-4294-b9ff-29ba205cfa00 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:33.456009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 308/610] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:33.456202 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801aef3-dea5-4294-b9ff-29ba205cfa00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:33.464341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5506d-d5f2-43c7-aff5-f42883089cfe None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:33.464626 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5506d-d5f2-43c7-aff5-f42883089cfe None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:33.464903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5506d-d5f2-43c7-aff5-f42883089cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:33.473456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801aef3-dea5-4294-b9ff-29ba205cfa00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:33.479921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-8801aef3-dea5-4294-b9ff-29ba205cfa00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:33.479921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:33.479921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:33.479921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:33.479921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:33.479921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:33.479921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:33.479921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:33.479921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:33.479921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:33.479921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:33.479921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:33.479921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:33.479921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:33.479921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:33.479921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:33.481070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:33.481070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:33.481070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:33.481070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:33.481070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:33.481070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:33.481070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:33.481070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:33.481070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:33.481070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:33.481070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:33.481070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:33.481070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:33.481070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:33.481070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:33.481070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:33.482128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:33.482128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:33.482128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:33.482128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:33.482128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:33.482128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:33.482128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:33.482128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:33.482128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:33.482128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:33.482128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:33.482128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:33.484449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 303/611] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:33.497390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801aef3-dea5-4294-b9ff-29ba205cfa00 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:33.502092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-09b5506d-d5f2-43c7-aff5-f42883089cfe None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:33.503309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-09b5506d-d5f2-43c7-aff5-f42883089cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:33.590096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 309/612] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:33.651320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801aef3-dea5-4294-b9ff-29ba205cfa00 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:33.699769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc1922-3d1a-41ca-a1ca-e89d33f70db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:33.700379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc1922-3d1a-41ca-a1ca-e89d33f70db8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:33.700663 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc1922-3d1a-41ca-a1ca-e89d33f70db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:33.700993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc1922-3d1a-41ca-a1ca-e89d33f70db8 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:33.701665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc1922-3d1a-41ca-a1ca-e89d33f70db8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:33.702022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc1922-3d1a-41ca-a1ca-e89d33f70db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:33.703413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc1922-3d1a-41ca-a1ca-e89d33f70db8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:33.715387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 304/613] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:33.720866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5506d-d5f2-43c7-aff5-f42883089cfe None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:33.761537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:33.856870 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5506d-d5f2-43c7-aff5-f42883089cfe None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:33.900615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464dc558-3819-447d-9b12-5365f3d2cc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:33.901657 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dc558-3819-447d-9b12-5365f3d2cc33 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:33.902166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dc558-3819-447d-9b12-5365f3d2cc33 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:33.902639 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dc558-3819-447d-9b12-5365f3d2cc33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:33.917691 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464dc558-3819-447d-9b12-5365f3d2cc33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:33.919444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464dc558-3819-447d-9b12-5365f3d2cc33 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:33.939489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-464dc558-3819-447d-9b12-5365f3d2cc33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:33.939489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:33.939489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:33.939489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:33.939489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:33.939489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:33.939489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:33.939489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:33.939489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:33.939489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:33.939489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:33.939489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:33.939489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:33.939489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:33.939489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:33.939489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:33.940473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:33.940473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:33.940473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:33.940473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:33.940473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:33.940473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:33.940473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:33.940473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:33.940473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:33.940473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:33.940473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:33.940473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:33.940473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:33.940473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:33.940473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:33.940473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:33.940473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:33.941364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:33.941364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:33.941364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:33.948020 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 310/614] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:33.953525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc1922-3d1a-41ca-a1ca-e89d33f70db8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:33.987442 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:33.990142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464dc558-3819-447d-9b12-5365f3d2cc33 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:34.123432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:34.148854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc1922-3d1a-41ca-a1ca-e89d33f70db8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:34.162317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464dc558-3819-447d-9b12-5365f3d2cc33 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:34.220925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c078ef-7293-4e99-adf3-0e052bed919d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:34.222553 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c078ef-7293-4e99-adf3-0e052bed919d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:34.223254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c078ef-7293-4e99-adf3-0e052bed919d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:34.224911 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c078ef-7293-4e99-adf3-0e052bed919d None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:34.226368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c078ef-7293-4e99-adf3-0e052bed919d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:34.227084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c078ef-7293-4e99-adf3-0e052bed919d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:34.230393 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c078ef-7293-4e99-adf3-0e052bed919d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:34.237747 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531f3ea-6ac1-4161-9d33-655d9374ff8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:34.242413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531f3ea-6ac1-4161-9d33-655d9374ff8f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:34.242910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531f3ea-6ac1-4161-9d33-655d9374ff8f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:34.244067 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531f3ea-6ac1-4161-9d33-655d9374ff8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:34.255008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 305/615] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:34.259652 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531f3ea-6ac1-4161-9d33-655d9374ff8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:34.261275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c078ef-7293-4e99-adf3-0e052bed919d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:34.269083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-6531f3ea-6ac1-4161-9d33-655d9374ff8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:34.269083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:34.269083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:34.269083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:34.269083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:34.269083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:34.269083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:34.269083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:34.269083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:34.269083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:34.269083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:34.269083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:34.269083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:34.269083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:34.269083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:34.269083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:34.270045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:34.270045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:34.270045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:34.270045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:34.270045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:34.270045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:34.270045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:34.270045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:34.270045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:34.270045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:34.270045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:34.270045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:34.270045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:34.270045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:34.270045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:34.270045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:34.270917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:34.270917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:34.270917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:34.270917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:34.270917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:34.270917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:34.270917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:34.270917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:34.270917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:34.270917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:34.270917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:34.270917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:34.273451 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 311/616] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:34.279984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531f3ea-6ac1-4161-9d33-655d9374ff8f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:34.383378 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:34.397772 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531f3ea-6ac1-4161-9d33-655d9374ff8f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:34.408799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c078ef-7293-4e99-adf3-0e052bed919d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:34.444695 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ab5ac-6192-4f97-ac01-f0eacb6b3239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:34.445327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ab5ac-6192-4f97-ac01-f0eacb6b3239 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:34.445610 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ab5ac-6192-4f97-ac01-f0eacb6b3239 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:34.445886 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ab5ac-6192-4f97-ac01-f0eacb6b3239 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:34.453496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ab5ac-6192-4f97-ac01-f0eacb6b3239 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:34.455025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ab5ac-6192-4f97-ac01-f0eacb6b3239 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:34.467349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-655ab5ac-6192-4f97-ac01-f0eacb6b3239 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:12:34.467349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:34.467349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:34.467349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:34.467349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:34.467349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:34.467349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:34.467349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:34.467349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:34.467349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:34.467349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:34.467349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:34.467349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:34.467349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:34.467349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:34.467349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:34.468323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:34.468323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:34.468323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:34.468323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:34.468323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:34.468323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:34.468323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:34.468323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:34.468323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:34.468323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:34.468323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:34.468323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:34.468323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:34.468323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:34.468323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:34.468323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:34.468323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:34.468323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:34.469300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:34.469300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:34.469300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:34.469300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:34.469300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:34.469300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:34.469300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:34.469300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:34.469300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:12:34.469300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:34.469300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 306/617] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 23 16:12:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:34.473934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ab5ac-6192-4f97-ac01-f0eacb6b3239 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:34.488952 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a695f2-cbac-43b6-b78c-eeef0eac9dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:34.489839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a695f2-cbac-43b6-b78c-eeef0eac9dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:34.490339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a695f2-cbac-43b6-b78c-eeef0eac9dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:34.490791 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a695f2-cbac-43b6-b78c-eeef0eac9dc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:34.491641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a695f2-cbac-43b6-b78c-eeef0eac9dc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:34.492138 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a695f2-cbac-43b6-b78c-eeef0eac9dc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:34.494277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a695f2-cbac-43b6-b78c-eeef0eac9dc6 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:34.513390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 312/618] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:34.519431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a695f2-cbac-43b6-b78c-eeef0eac9dc6 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:34.530092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:34.586293 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ab5ac-6192-4f97-ac01-f0eacb6b3239 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:34.623167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d7eda-b395-435e-b510-008755320b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:34.623782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d7eda-b395-435e-b510-008755320b9a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:34.624066 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d7eda-b395-435e-b510-008755320b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:34.624340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d7eda-b395-435e-b510-008755320b9a None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:34.625075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d7eda-b395-435e-b510-008755320b9a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:34.625385 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d7eda-b395-435e-b510-008755320b9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:34.626904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d7eda-b395-435e-b510-008755320b9a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:34.629642 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:34.651994 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 307/619] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 23 16:12:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:34.653236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d7eda-b395-435e-b510-008755320b9a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:34.671213 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a695f2-cbac-43b6-b78c-eeef0eac9dc6 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:34.707919 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab82de-25c9-4419-b9b2-58834fe630f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:34.708579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab82de-25c9-4419-b9b2-58834fe630f6 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:34.708861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab82de-25c9-4419-b9b2-58834fe630f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:34.709132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab82de-25c9-4419-b9b2-58834fe630f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:34.723538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab82de-25c9-4419-b9b2-58834fe630f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:34.724992 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab82de-25c9-4419-b9b2-58834fe630f6 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:34.739906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-4eab82de-25c9-4419-b9b2-58834fe630f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:34.739906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:34.739906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:34.739906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:34.739906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:34.739906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:34.739906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:34.739906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:34.739906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:34.739906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:34.739906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:34.739906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:34.739906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:34.739906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:34.739906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:34.739906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:34.741044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:34.741044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:34.741044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:34.741044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:34.741044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:34.741044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:34.741044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:34.741044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:34.741044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:34.741044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:34.741044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:34.741044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:34.741044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:34.741044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:34.741044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:34.741044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:34.741044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:34.741917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:34.741917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:34.741917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:34.741917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 313/620] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:34.747680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252eefc-6c6e-4951-8a73-6cb1ce147170 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:34.747971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252eefc-6c6e-4951-8a73-6cb1ce147170 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:34.748254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252eefc-6c6e-4951-8a73-6cb1ce147170 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:34.749770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 314/621] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:34.750522 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252eefc-6c6e-4951-8a73-6cb1ce147170 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:34.763970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d7eda-b395-435e-b510-008755320b9a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:34.801884 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da560d-8966-45f4-93b4-c37f26666405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:34.802530 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da560d-8966-45f4-93b4-c37f26666405 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:34.802815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da560d-8966-45f4-93b4-c37f26666405 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:34.803145 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da560d-8966-45f4-93b4-c37f26666405 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:34.818510 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:34.859511 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252eefc-6c6e-4951-8a73-6cb1ce147170 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:34.872347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:34.885514 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da560d-8966-45f4-93b4-c37f26666405 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:34.887002 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da560d-8966-45f4-93b4-c37f26666405 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:34.907231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3491a0-ae40-45d9-b1c7-72a35644d06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:34.907956 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3491a0-ae40-45d9-b1c7-72a35644d06f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:34.908237 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3491a0-ae40-45d9-b1c7-72a35644d06f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:34.908507 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3491a0-ae40-45d9-b1c7-72a35644d06f None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:34.909926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3491a0-ae40-45d9-b1c7-72a35644d06f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:34.910448 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3491a0-ae40-45d9-b1c7-72a35644d06f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:34.912335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3491a0-ae40-45d9-b1c7-72a35644d06f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:34.934162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 315/622] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:34.936906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839477f-d422-41c5-85c2-1df540488b90 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:34.937191 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839477f-d422-41c5-85c2-1df540488b90 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:34.937465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839477f-d422-41c5-85c2-1df540488b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:34.955205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-c839477f-d422-41c5-85c2-1df540488b90 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:34.956409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c839477f-d422-41c5-85c2-1df540488b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:35.013545 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 308/623] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:12:35.014921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da560d-8966-45f4-93b4-c37f26666405 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:35.030928 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 316/624] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:35.031914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839477f-d422-41c5-85c2-1df540488b90 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:35.090494 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:35.133684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:35.147189 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da560d-8966-45f4-93b4-c37f26666405 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:35.150673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839477f-d422-41c5-85c2-1df540488b90 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:35.192037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e81dcc-76e3-4bb4-8d4e-4330a5b656ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:35.192898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e81dcc-76e3-4bb4-8d4e-4330a5b656ba None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:35.193351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e81dcc-76e3-4bb4-8d4e-4330a5b656ba None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:35.193787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e81dcc-76e3-4bb4-8d4e-4330a5b656ba None admin] PATH_INFO: `/v3/users/swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:35.197566 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da32be-85ea-4156-acfa-b7a9ab7d7b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:35.198328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da32be-85ea-4156-acfa-b7a9ab7d7b2a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:35.198702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da32be-85ea-4156-acfa-b7a9ab7d7b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:35.199068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da32be-85ea-4156-acfa-b7a9ab7d7b2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:35.202332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e81dcc-76e3-4bb4-8d4e-4330a5b656ba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:35.204045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e81dcc-76e3-4bb4-8d4e-4330a5b656ba None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:35.211855 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da32be-85ea-4156-acfa-b7a9ab7d7b2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:35.213906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da32be-85ea-4156-acfa-b7a9ab7d7b2a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:35.217239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-a0e81dcc-76e3-4bb4-8d4e-4330a5b656ba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:12:35.217239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:35.217239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:35.217239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:35.217239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:35.217239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:35.217239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:35.217239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:35.217239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:35.217239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:35.217239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:35.217239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:35.217239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:35.217239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:35.217239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:35.217239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:35.218196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:35.218196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:35.218196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:35.218196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:35.218196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:35.218196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:35.218196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:35.218196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:35.218196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:35.218196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:35.218196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:35.218196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:35.218196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:35.218196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:35.218196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:35.218196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:35.218196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:35.218196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:35.219156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:35.219156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:35.219156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:35.219156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:35.219156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:35.219156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:35.219156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:35.219156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:35.219156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:12:35.219156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:35.226027 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 309/625] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:12:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:35.227607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964d848-6467-43b8-8fdb-f989fc2d9fd8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:35.228337 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964d848-6467-43b8-8fdb-f989fc2d9fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:35.228834 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964d848-6467-43b8-8fdb-f989fc2d9fd8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:35.229437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-a7da32be-85ea-4156-acfa-b7a9ab7d7b2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:35.229437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:35.229437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:35.229437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:35.229437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:35.229437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:35.229437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:35.229437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:35.229437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:35.229437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:35.229437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:35.229437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:35.229437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:35.229437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:35.229437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:35.229437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:35.230396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:35.230396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:35.230396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:35.230396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:35.230396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:35.230396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:35.230396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:35.230396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:35.230396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:35.230396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:35.230396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:35.230396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:35.230396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:35.230396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:35.230396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:35.230396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:35.230396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:35.231310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:35.231310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:35.231310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:35.231310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 317/626] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:35.235525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 310/627] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:35.236933 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da32be-85ea-4156-acfa-b7a9ab7d7b2a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:35.237781 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964d848-6467-43b8-8fdb-f989fc2d9fd8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:35.339707 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:35.346470 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da32be-85ea-4156-acfa-b7a9ab7d7b2a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:35.355711 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964d848-6467-43b8-8fdb-f989fc2d9fd8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:35.382930 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea93ae-0fd9-441f-a0b4-2ab551167286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:35.383696 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea93ae-0fd9-441f-a0b4-2ab551167286 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:35.384683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea93ae-0fd9-441f-a0b4-2ab551167286 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:35.385092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea93ae-0fd9-441f-a0b4-2ab551167286 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:35.385843 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea93ae-0fd9-441f-a0b4-2ab551167286 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:35.386304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea93ae-0fd9-441f-a0b4-2ab551167286 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:35.387746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea93ae-0fd9-441f-a0b4-2ab551167286 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:35.391863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653774ca-050c-4c81-863f-65d650479558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:35.392476 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653774ca-050c-4c81-863f-65d650479558 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:35.392750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653774ca-050c-4c81-863f-65d650479558 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:35.393024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653774ca-050c-4c81-863f-65d650479558 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:35.393663 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653774ca-050c-4c81-863f-65d650479558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:35.393967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653774ca-050c-4c81-863f-65d650479558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:35.395333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653774ca-050c-4c81-863f-65d650479558 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:35.410950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 318/628] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 23 16:12:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:35.411157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 311/629] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:35.411157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653774ca-050c-4c81-863f-65d650479558 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:35.412443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c51238-ea29-49b4-aa05-c942f6ced1a9 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:35.412762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c51238-ea29-49b4-aa05-c942f6ced1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:35.413050 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c51238-ea29-49b4-aa05-c942f6ced1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:35.428111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:35.432776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-43c51238-ea29-49b4-aa05-c942f6ced1a9 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:35.434529 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-43c51238-ea29-49b4-aa05-c942f6ced1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:35.514094 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 319/630] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:35.514094 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c51238-ea29-49b4-aa05-c942f6ced1a9 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:35.528929 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653774ca-050c-4c81-863f-65d650479558 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:35.567378 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de14b40-879a-4d08-8fdd-e7ec331a57e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:35.568013 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de14b40-879a-4d08-8fdd-e7ec331a57e3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:35.568298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de14b40-879a-4d08-8fdd-e7ec331a57e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:35.568574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de14b40-879a-4d08-8fdd-e7ec331a57e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:35.579028 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de14b40-879a-4d08-8fdd-e7ec331a57e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:35.583779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-7de14b40-879a-4d08-8fdd-e7ec331a57e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:35.583779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:35.583779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:35.583779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:35.583779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:35.583779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:35.583779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:35.583779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:35.583779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:35.583779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:35.583779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:35.583779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:35.583779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:35.583779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:35.583779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:35.583779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:35.584697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:35.584697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:35.584697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:35.584697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:35.584697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:35.584697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:35.584697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:35.584697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:35.584697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:35.584697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:35.584697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:35.584697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:35.584697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:35.584697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:35.584697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:35.584697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:35.585519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:35.585519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:35.585519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:35.585519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:35.585519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:35.585519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:35.585519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:35.585519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:35.585519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:35.585519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:35.585519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:35.585519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:35.585519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 312/631] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:35.586243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de14b40-879a-4d08-8fdd-e7ec331a57e3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:35.615523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:35.632422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c51238-ea29-49b4-aa05-c942f6ced1a9 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:35.670371 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:35.674129 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc7e3c-21c1-42de-b833-3c3315258fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:35.675040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc7e3c-21c1-42de-b833-3c3315258fee None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:35.675321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc7e3c-21c1-42de-b833-3c3315258fee None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:35.675592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc7e3c-21c1-42de-b833-3c3315258fee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:35.688414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc7e3c-21c1-42de-b833-3c3315258fee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:35.689801 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc7e3c-21c1-42de-b833-3c3315258fee None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:35.696375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de14b40-879a-4d08-8fdd-e7ec331a57e3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:35.705452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-81bc7e3c-21c1-42de-b833-3c3315258fee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:35.705452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:35.705452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:35.705452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:35.705452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:35.705452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:35.705452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:35.705452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:35.705452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:35.705452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:35.705452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:35.705452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:35.705452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:35.705452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:35.705452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:35.705452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:35.706731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:35.706731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:35.706731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:35.706731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:35.706731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:35.706731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:35.706731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:35.706731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:35.706731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:35.706731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:35.706731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:35.706731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:35.706731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:35.706731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:35.706731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:35.706731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:35.706731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:35.707873 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:35.707873 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:35.707873 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:35.707873 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 320/632] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:35.707873 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a997d-6f80-4488-a313-de64813b1548 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:35.708173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a997d-6f80-4488-a313-de64813b1548 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:35.708678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a997d-6f80-4488-a313-de64813b1548 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:35.714910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 321/633] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:35.714910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a997d-6f80-4488-a313-de64813b1548 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:35.742340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6ce4c-d2a3-407d-949a-af6ebc375d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:35.743829 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6ce4c-d2a3-407d-949a-af6ebc375d2f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:35.744333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6ce4c-d2a3-407d-949a-af6ebc375d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:35.744791 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6ce4c-d2a3-407d-949a-af6ebc375d2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:35.752318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6ce4c-d2a3-407d-949a-af6ebc375d2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:35.753968 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6ce4c-d2a3-407d-949a-af6ebc375d2f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:35.765697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e7d6ce4c-d2a3-407d-949a-af6ebc375d2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:35.765697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:35.765697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:35.765697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:35.765697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:35.765697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:35.765697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:35.765697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:35.765697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:35.765697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:35.765697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:35.765697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:35.765697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:35.765697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:35.765697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:35.766876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:35.766876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:35.766876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:35.766876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:35.766876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:35.766876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:35.766876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:35.766876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:35.766876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:35.766876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:35.766876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:35.766876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:35.766876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:35.766876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:35.766876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:35.766876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:35.766876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:35.767796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:35.767796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:35.767796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:35.767796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:35.767796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:35.767796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:35.767796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:35.767796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:35.767796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 313/634] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:35.768331 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38967ef1-58ad-4828-8697-43e34334fb5c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:35.768870 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38967ef1-58ad-4828-8697-43e34334fb5c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:35.768870 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38967ef1-58ad-4828-8697-43e34334fb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:35.786773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-38967ef1-58ad-4828-8697-43e34334fb5c None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:35.787965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-38967ef1-58ad-4828-8697-43e34334fb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:35.827548 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a997d-6f80-4488-a313-de64813b1548 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:35.854935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 314/635] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:35.855767 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38967ef1-58ad-4828-8697-43e34334fb5c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:35.878993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d128c0-e4d3-4e82-9268-f59fada1cc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:35.879709 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d128c0-e4d3-4e82-9268-f59fada1cc04 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:35.879997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d128c0-e4d3-4e82-9268-f59fada1cc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:35.880273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d128c0-e4d3-4e82-9268-f59fada1cc04 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:35.880907 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d128c0-e4d3-4e82-9268-f59fada1cc04 None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:35.881209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d128c0-e4d3-4e82-9268-f59fada1cc04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:35.882830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d128c0-e4d3-4e82-9268-f59fada1cc04 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:35.885756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:35.898519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 322/636] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:35.899400 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d128c0-e4d3-4e82-9268-f59fada1cc04 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:35.920835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:35.966729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38967ef1-58ad-4828-8697-43e34334fb5c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:36.004647 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff017a9-d555-4543-94ad-51cff0f10490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:36.005501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff017a9-d555-4543-94ad-51cff0f10490 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:36.005954 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff017a9-d555-4543-94ad-51cff0f10490 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:36.006269 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff017a9-d555-4543-94ad-51cff0f10490 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:36.006941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff017a9-d555-4543-94ad-51cff0f10490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:36.007277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff017a9-d555-4543-94ad-51cff0f10490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:36.008401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d128c0-e4d3-4e82-9268-f59fada1cc04 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:36.008652 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff017a9-d555-4543-94ad-51cff0f10490 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:36.026818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 315/637] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:36.026818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff017a9-d555-4543-94ad-51cff0f10490 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:36.052738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11971d1e-5ed7-4cf7-9927-fd4ce895a1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:36.053345 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11971d1e-5ed7-4cf7-9927-fd4ce895a1e0 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:36.053626 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11971d1e-5ed7-4cf7-9927-fd4ce895a1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:36.053901 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11971d1e-5ed7-4cf7-9927-fd4ce895a1e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:36.054621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11971d1e-5ed7-4cf7-9927-fd4ce895a1e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:36.054930 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11971d1e-5ed7-4cf7-9927-fd4ce895a1e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:36.056907 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11971d1e-5ed7-4cf7-9927-fd4ce895a1e0 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:36.068682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 323/638] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:36.069476 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11971d1e-5ed7-4cf7-9927-fd4ce895a1e0 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:36.131839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:36.134623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff017a9-d555-4543-94ad-51cff0f10490 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:36.160259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:36.170153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130fc24-11eb-4c78-b939-cb7892cd7f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:36.170789 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130fc24-11eb-4c78-b939-cb7892cd7f94 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:36.171075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130fc24-11eb-4c78-b939-cb7892cd7f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:36.171350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130fc24-11eb-4c78-b939-cb7892cd7f94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:36.181862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11971d1e-5ed7-4cf7-9927-fd4ce895a1e0 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:36.184049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130fc24-11eb-4c78-b939-cb7892cd7f94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:36.190339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-1130fc24-11eb-4c78-b939-cb7892cd7f94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:36.190339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:36.190339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:36.190339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:36.190339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:36.190339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:36.190339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:36.190339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:36.190339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:36.190339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:36.190339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:36.190339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:36.190339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:36.190339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:36.190339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:36.190339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:36.191263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:36.191263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:36.191263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:36.191263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:36.191263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:36.191263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:36.191263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:36.191263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:36.191263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:36.191263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:36.191263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:36.191263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:36.191263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:36.191263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:36.191263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:36.191263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:36.192110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:36.192110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:36.192110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:36.192110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:36.192110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:36.192110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:36.192110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:36.192110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:36.192110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:36.192110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:36.192110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:36.192110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:36.192110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 316/639] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:36.193219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130fc24-11eb-4c78-b939-cb7892cd7f94 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:36.217271 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5f8de-9c60-4930-8cad-5be52d30aba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:36.217823 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5f8de-9c60-4930-8cad-5be52d30aba2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:36.218142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5f8de-9c60-4930-8cad-5be52d30aba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:36.218416 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5f8de-9c60-4930-8cad-5be52d30aba2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:36.228838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5f8de-9c60-4930-8cad-5be52d30aba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:36.230308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5f8de-9c60-4930-8cad-5be52d30aba2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:36.244060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-f2c5f8de-9c60-4930-8cad-5be52d30aba2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:36.244060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:36.244060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:36.244060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:36.244060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:36.244060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:36.244060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:36.244060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:36.244060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:36.244060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:36.244060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:36.244060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:36.244060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:36.244060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:36.244060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:36.244060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:36.245055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:36.245055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:36.245055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:36.245055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:36.245055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:36.245055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:36.245055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:36.245055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:36.245055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:36.245055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:36.245055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:36.245055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:36.245055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:36.245055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:36.245055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:36.245055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:36.245055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:36.245966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:36.245966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:36.245966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:36.245966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 324/640] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:36.245966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5f8de-9c60-4930-8cad-5be52d30aba2 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:36.297285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130fc24-11eb-4c78-b939-cb7892cd7f94 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:36.329793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42f97e-632b-43c1-9843-1816e2506d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:36.330442 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42f97e-632b-43c1-9843-1816e2506d15 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:36.330722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42f97e-632b-43c1-9843-1816e2506d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:36.330989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42f97e-632b-43c1-9843-1816e2506d15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:36.338248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42f97e-632b-43c1-9843-1816e2506d15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:36.339763 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42f97e-632b-43c1-9843-1816e2506d15 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:36.349770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5f8de-9c60-4930-8cad-5be52d30aba2 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:36.351615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-7c42f97e-632b-43c1-9843-1816e2506d15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:36.351615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:36.351615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:36.351615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:36.351615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:36.351615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:36.351615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:36.351615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:36.351615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:36.351615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:36.351615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:36.351615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:36.351615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:36.351615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:36.351615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:36.352706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:36.352706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:36.352706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:36.352706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:36.352706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:36.352706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:36.352706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:36.352706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:36.352706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:36.352706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:36.352706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:36.352706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:36.352706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:36.352706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:36.352706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:36.352706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:36.352706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:36.353768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:36.353768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:36.353768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:36.353768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:36.353768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:36.353768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:36.353768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:36.353768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:36.353768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 317/641] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:36.353768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42f97e-632b-43c1-9843-1816e2506d15 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:36.363047 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:36.387669 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f950eb-8399-477a-813e-435824625099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:36.388271 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f950eb-8399-477a-813e-435824625099 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:36.388550 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f950eb-8399-477a-813e-435824625099 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:36.388822 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f950eb-8399-477a-813e-435824625099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:36.389547 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f950eb-8399-477a-813e-435824625099 None admin] RBAC: Adding query filter params (role.id=bbf63b75406649a3b653308ecb75062d, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=767ca33ca8e244f8a0cc773e3b6abefb) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:36.389854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f950eb-8399-477a-813e-435824625099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:36.391320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f950eb-8399-477a-813e-435824625099 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:36.397032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 325/642] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:12:36 2022] GET /identity/v3/role_assignments?user.id=767ca33ca8e244f8a0cc773e3b6abefb&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=bbf63b75406649a3b653308ecb75062d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:36.397801 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f950eb-8399-477a-813e-435824625099 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:36.403042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:36.466370 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42f97e-632b-43c1-9843-1816e2506d15 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:36.503513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd2961-41fa-487c-b6b8-ec279a4f26d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:36.504055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd2961-41fa-487c-b6b8-ec279a4f26d6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:36.504337 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd2961-41fa-487c-b6b8-ec279a4f26d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:36.504611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd2961-41fa-487c-b6b8-ec279a4f26d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:36.517434 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd2961-41fa-487c-b6b8-ec279a4f26d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:36.522746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-31fd2961-41fa-487c-b6b8-ec279a4f26d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:36.522746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:36.522746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:36.522746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:36.522746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:36.522746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:36.522746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:36.522746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:36.522746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:36.522746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:36.522746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:36.522746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:36.522746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:36.522746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:36.522746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:36.522746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:36.523746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:36.523746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:36.523746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:36.523746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:36.523746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:36.523746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:36.523746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:36.523746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:36.523746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:36.523746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:36.523746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:36.523746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:36.523746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:36.523746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:36.523746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:36.523746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:36.524673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:36.524673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:36.524673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:36.524673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:36.524673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:36.524673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:36.524673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:36.524673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:36.524673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:36.524673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:36.524673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:36.524673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:36.529385 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 318/643] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:36.530390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd2961-41fa-487c-b6b8-ec279a4f26d6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:36.532829 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f950eb-8399-477a-813e-435824625099 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:36.577132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d35bd6-73fe-451d-aab8-ac3a30879860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:36.578016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d35bd6-73fe-451d-aab8-ac3a30879860 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:36.578016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d35bd6-73fe-451d-aab8-ac3a30879860 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:36.578368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d35bd6-73fe-451d-aab8-ac3a30879860 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:36.579508 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d35bd6-73fe-451d-aab8-ac3a30879860 None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:36.579508 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d35bd6-73fe-451d-aab8-ac3a30879860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:36.580694 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d35bd6-73fe-451d-aab8-ac3a30879860 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:36.589365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 326/644] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:36.590510 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d35bd6-73fe-451d-aab8-ac3a30879860 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:36.638489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:36.651065 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd2961-41fa-487c-b6b8-ec279a4f26d6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:36.654259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:36.689320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac10794-f8b9-4ed6-8577-30a7e7fc2fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:36.689984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac10794-f8b9-4ed6-8577-30a7e7fc2fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:36.690234 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac10794-f8b9-4ed6-8577-30a7e7fc2fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:36.690503 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac10794-f8b9-4ed6-8577-30a7e7fc2fd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:36.691148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac10794-f8b9-4ed6-8577-30a7e7fc2fd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:36.691448 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac10794-f8b9-4ed6-8577-30a7e7fc2fd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:36.692815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac10794-f8b9-4ed6-8577-30a7e7fc2fd3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:36.705717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 319/645] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:36.706575 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac10794-f8b9-4ed6-8577-30a7e7fc2fd3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:36.712448 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d35bd6-73fe-451d-aab8-ac3a30879860 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:36.750306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f27b79-e1dc-4314-9fa8-867579ff82a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:36.750943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f27b79-e1dc-4314-9fa8-867579ff82a4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:36.751225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f27b79-e1dc-4314-9fa8-867579ff82a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:36.751501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f27b79-e1dc-4314-9fa8-867579ff82a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:36.752210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f27b79-e1dc-4314-9fa8-867579ff82a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:36.752516 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f27b79-e1dc-4314-9fa8-867579ff82a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:36.754001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f27b79-e1dc-4314-9fa8-867579ff82a4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:36.767244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 327/646] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:36.767995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f27b79-e1dc-4314-9fa8-867579ff82a4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:36.821898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac10794-f8b9-4ed6-8577-30a7e7fc2fd3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:36.856462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bf14e-acd6-4560-a827-3dbe4e5ca3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:36.857071 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bf14e-acd6-4560-a827-3dbe4e5ca3de None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:36.857359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bf14e-acd6-4560-a827-3dbe4e5ca3de None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:36.857636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bf14e-acd6-4560-a827-3dbe4e5ca3de None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:36.858409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bf14e-acd6-4560-a827-3dbe4e5ca3de None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:36.858719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bf14e-acd6-4560-a827-3dbe4e5ca3de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:36.860079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bf14e-acd6-4560-a827-3dbe4e5ca3de None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:36.869078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 320/647] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:36.870392 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bf14e-acd6-4560-a827-3dbe4e5ca3de None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:36.874829 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:36.880603 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f27b79-e1dc-4314-9fa8-867579ff82a4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:36.903241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:36.921604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7417b-e0ca-4b94-a1c1-1733fb0a52e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:36.922291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7417b-e0ca-4b94-a1c1-1733fb0a52e1 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:36.922574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7417b-e0ca-4b94-a1c1-1733fb0a52e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:36.922849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7417b-e0ca-4b94-a1c1-1733fb0a52e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:36.933955 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7417b-e0ca-4b94-a1c1-1733fb0a52e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:36.935423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7417b-e0ca-4b94-a1c1-1733fb0a52e1 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:36.951719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-0eb7417b-e0ca-4b94-a1c1-1733fb0a52e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:36.951719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:36.951719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:36.951719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:36.951719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:36.951719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:36.951719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:36.951719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:36.951719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:36.951719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:36.951719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:36.951719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:36.951719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:36.951719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:36.951719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:36.951719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:36.952739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:36.952739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:36.952739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:36.952739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:36.952739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:36.952739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:36.952739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:36.952739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:36.952739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:36.952739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:36.952739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:36.952739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:36.952739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:36.952739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:36.952739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:36.952739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:36.952739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:36.953635 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:36.953635 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:36.953635 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:36.953635 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 328/648] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:36.953635 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7417b-e0ca-4b94-a1c1-1733fb0a52e1 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:36.988195 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bf14e-acd6-4560-a827-3dbe4e5ca3de None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:37.027302 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d89b4-a320-426f-ac79-96ba57fff04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:37.027857 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d89b4-a320-426f-ac79-96ba57fff04f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:37.028139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d89b4-a320-426f-ac79-96ba57fff04f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:37.028414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d89b4-a320-426f-ac79-96ba57fff04f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:37.036302 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d89b4-a320-426f-ac79-96ba57fff04f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:37.037730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d89b4-a320-426f-ac79-96ba57fff04f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:37.049367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-404d89b4-a320-426f-ac79-96ba57fff04f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:12:37.049367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:37.049367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:37.049367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:37.049367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:37.049367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:37.049367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:37.049367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:37.049367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:37.049367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:37.049367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:37.049367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:37.049367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:37.049367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:37.049367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:37.049367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:37.050387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:37.050387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:37.050387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:37.050387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:37.050387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:37.050387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:37.050387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:37.050387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:37.050387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:37.050387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:37.050387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:37.050387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:37.050387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:37.050387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:37.050387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:37.050387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:37.050387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:37.050387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:37.051336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:37.051336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:37.051336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:37.051336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:37.051336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:37.051336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:37.051336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:37.051336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:37.051336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 16:12:37.051336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:37.051336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 321/649] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:37.051336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d89b4-a320-426f-ac79-96ba57fff04f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:37.074040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7417b-e0ca-4b94-a1c1-1733fb0a52e1 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:37.110993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb17e7f-4e6f-404e-a39d-e43f5e11a0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:37.111740 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb17e7f-4e6f-404e-a39d-e43f5e11a0fd None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:37.112086 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb17e7f-4e6f-404e-a39d-e43f5e11a0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:37.112424 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb17e7f-4e6f-404e-a39d-e43f5e11a0fd None admin] PATH_INFO: `/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/e7fb290911bc4de887d04b71731f76b5/roles/bbf63b75406649a3b653308ecb75062d` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:37.128616 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb17e7f-4e6f-404e-a39d-e43f5e11a0fd None admin] RBAC: Authorizing `identity:create_grant(project_id=15a0439c9dd3406f81e2740fe775782b, user_id=e7fb290911bc4de887d04b71731f76b5, role_id=bbf63b75406649a3b653308ecb75062d)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:37.130055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb17e7f-4e6f-404e-a39d-e43f5e11a0fd None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:37.139832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:37.145569 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 329/650] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:12:36 2022] PUT /identity/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/e7fb290911bc4de887d04b71731f76b5/roles/bbf63b75406649a3b653308ecb75062d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:12:37.155487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb17e7f-4e6f-404e-a39d-e43f5e11a0fd None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:37.156580 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:37.178022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d89b4-a320-426f-ac79-96ba57fff04f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:37.227162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fa26d-65db-4a18-994d-37bf8edf8fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:37.228867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fa26d-65db-4a18-994d-37bf8edf8fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:37.229252 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fa26d-65db-4a18-994d-37bf8edf8fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:37.229637 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fa26d-65db-4a18-994d-37bf8edf8fa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:37.243051 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fa26d-65db-4a18-994d-37bf8edf8fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:37.245301 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519fa26d-65db-4a18-994d-37bf8edf8fa9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:37.263389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-519fa26d-65db-4a18-994d-37bf8edf8fa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:37.263389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:37.263389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:37.263389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:37.263389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:37.263389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:37.263389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:37.263389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:37.263389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:37.263389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:37.263389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:37.263389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:37.263389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:37.263389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:37.263389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:37.263389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:37.264423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:37.264423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:37.264423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:37.264423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:37.264423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:37.264423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:37.264423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:37.264423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:37.264423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:37.264423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:37.264423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:37.264423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:37.264423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:37.264423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:37.264423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:37.264423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:37.264423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:37.265301 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:37.265301 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:37.265301 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:37.269871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 322/651] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:37.270882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fa26d-65db-4a18-994d-37bf8edf8fa9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:37.307872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb17e7f-4e6f-404e-a39d-e43f5e11a0fd None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:37.355035 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e3391-27a4-43c4-a9a8-55ad9daa4006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:37.355708 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e3391-27a4-43c4-a9a8-55ad9daa4006 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:37.355990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e3391-27a4-43c4-a9a8-55ad9daa4006 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:37.356259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e3391-27a4-43c4-a9a8-55ad9daa4006 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:37.358827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e3391-27a4-43c4-a9a8-55ad9daa4006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:37.359362 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e3391-27a4-43c4-a9a8-55ad9daa4006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:37.361509 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e3391-27a4-43c4-a9a8-55ad9daa4006 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:37.377966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 330/652] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:37.379595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e3391-27a4-43c4-a9a8-55ad9daa4006 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:37.392714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519fa26d-65db-4a18-994d-37bf8edf8fa9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:37.434399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1069451-f850-4404-a49c-c022fce6f9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:37.435696 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1069451-f850-4404-a49c-c022fce6f9ac None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:37.436658 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1069451-f850-4404-a49c-c022fce6f9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:37.437115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1069451-f850-4404-a49c-c022fce6f9ac None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:37.438478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1069451-f850-4404-a49c-c022fce6f9ac None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:37.439248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1069451-f850-4404-a49c-c022fce6f9ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:37.441151 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1069451-f850-4404-a49c-c022fce6f9ac None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:37.454258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:37.455964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:37.469996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 323/653] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 23 16:12:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:37.471542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1069451-f850-4404-a49c-c022fce6f9ac None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:37.505977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e3391-27a4-43c4-a9a8-55ad9daa4006 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:37.545890 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc374b-39da-4a5a-b7b5-53c9386717e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:37.546754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc374b-39da-4a5a-b7b5-53c9386717e2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:37.547103 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc374b-39da-4a5a-b7b5-53c9386717e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:37.547447 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc374b-39da-4a5a-b7b5-53c9386717e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:37.548151 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc374b-39da-4a5a-b7b5-53c9386717e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:37.548518 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc374b-39da-4a5a-b7b5-53c9386717e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:37.550055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc374b-39da-4a5a-b7b5-53c9386717e2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:37.564442 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 331/654] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:37.565248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc374b-39da-4a5a-b7b5-53c9386717e2 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:37.601724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1069451-f850-4404-a49c-c022fce6f9ac None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:37.639405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12de017-5006-4e79-a7c5-48d41902285b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:37.640149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12de017-5006-4e79-a7c5-48d41902285b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:37.640498 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12de017-5006-4e79-a7c5-48d41902285b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:37.640844 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12de017-5006-4e79-a7c5-48d41902285b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:37.648990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12de017-5006-4e79-a7c5-48d41902285b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:37.650715 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12de017-5006-4e79-a7c5-48d41902285b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:37.663449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b12de017-5006-4e79-a7c5-48d41902285b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:12:37.663449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:37.663449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:37.663449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:37.663449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:37.663449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:37.663449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:37.663449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:37.663449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:37.663449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:37.663449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:37.663449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:37.663449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:37.663449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:37.663449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:37.663449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:37.664621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:37.664621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:37.664621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:37.664621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:37.664621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:37.664621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:37.664621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:37.664621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:37.664621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:37.664621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:37.664621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:37.664621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:37.664621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:37.664621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:37.664621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:37.664621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:37.664621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:37.664621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:37.667042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:37.667042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:37.667042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:37.667042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:37.667042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:37.667042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:37.667042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:37.667042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:37.667042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 16:12:37.667042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:37.667042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 324/655] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:37.668314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12de017-5006-4e79-a7c5-48d41902285b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:37.708347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc374b-39da-4a5a-b7b5-53c9386717e2 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:37.728977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:37.746669 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:37.751107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0707997-73ec-4265-9c23-0376330e173f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:37.751719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0707997-73ec-4265-9c23-0376330e173f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:37.751995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0707997-73ec-4265-9c23-0376330e173f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:37.752275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0707997-73ec-4265-9c23-0376330e173f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:37.805383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12de017-5006-4e79-a7c5-48d41902285b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:37.831436 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0707997-73ec-4265-9c23-0376330e173f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:37.832826 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0707997-73ec-4265-9c23-0376330e173f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:37.857539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e074b-dc71-44f9-bce9-10fe1ff8a8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:37.858794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e074b-dc71-44f9-bce9-10fe1ff8a8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:37.859686 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e074b-dc71-44f9-bce9-10fe1ff8a8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:37.860440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e074b-dc71-44f9-bce9-10fe1ff8a8f1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:37.871952 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e074b-dc71-44f9-bce9-10fe1ff8a8f1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:37.874197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e074b-dc71-44f9-bce9-10fe1ff8a8f1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:37.891305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-103e074b-dc71-44f9-bce9-10fe1ff8a8f1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:12:37.891305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:37.891305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:37.891305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:37.891305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:37.891305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:37.891305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:37.891305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:37.891305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:37.891305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:37.891305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:37.891305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:37.891305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:37.891305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:37.891305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:37.891305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:37.892284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:37.892284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:37.892284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:37.892284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:37.892284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:37.892284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:37.892284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:37.892284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:37.892284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:37.892284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:37.892284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:37.892284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:37.892284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:37.892284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:37.892284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:37.892284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:37.892284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:37.892284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:37.893225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:37.893225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:37.893225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:37.893225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:37.893225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:37.893225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:37.893225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:37.893225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:37.893225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:12:37.893225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:37.895990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 325/656] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:37.897652 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e074b-dc71-44f9-bce9-10fe1ff8a8f1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:37.956309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 332/657] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:12:37.957320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0707997-73ec-4265-9c23-0376330e173f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:37.980369 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:38.027029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e074b-dc71-44f9-bce9-10fe1ff8a8f1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:38.044635 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:38.065318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222877b-ac0a-4f8a-8478-42a8b893c6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:38.065979 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222877b-ac0a-4f8a-8478-42a8b893c6bb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:38.066470 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222877b-ac0a-4f8a-8478-42a8b893c6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:38.066813 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222877b-ac0a-4f8a-8478-42a8b893c6bb None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:38.067623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222877b-ac0a-4f8a-8478-42a8b893c6bb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:38.068033 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222877b-ac0a-4f8a-8478-42a8b893c6bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:38.069759 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222877b-ac0a-4f8a-8478-42a8b893c6bb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:38.075362 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0707997-73ec-4265-9c23-0376330e173f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:38.090182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 326/658] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 23 16:12:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:38.090857 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222877b-ac0a-4f8a-8478-42a8b893c6bb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:38.118724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9cf80-05ba-4fa9-a69e-bbff02993f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:38.119641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9cf80-05ba-4fa9-a69e-bbff02993f73 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:38.119842 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9cf80-05ba-4fa9-a69e-bbff02993f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:38.120082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9cf80-05ba-4fa9-a69e-bbff02993f73 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:38.120848 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9cf80-05ba-4fa9-a69e-bbff02993f73 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:38.121139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9cf80-05ba-4fa9-a69e-bbff02993f73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:38.122703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9cf80-05ba-4fa9-a69e-bbff02993f73 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:38.147316 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 333/659] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 23 16:12:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:38.148495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9cf80-05ba-4fa9-a69e-bbff02993f73 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:38.209503 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222877b-ac0a-4f8a-8478-42a8b893c6bb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:38.248186 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8dc36-2493-45f0-84d0-89b85f62f617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:38.248691 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:38.248872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8dc36-2493-45f0-84d0-89b85f62f617 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:38.249162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8dc36-2493-45f0-84d0-89b85f62f617 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:38.249437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8dc36-2493-45f0-84d0-89b85f62f617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:38.262790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8dc36-2493-45f0-84d0-89b85f62f617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:38.264299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8dc36-2493-45f0-84d0-89b85f62f617 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:38.281613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-34f8dc36-2493-45f0-84d0-89b85f62f617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:38.281613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:38.281613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:38.281613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:38.281613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:38.281613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:38.281613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:38.281613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:38.281613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:38.281613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:38.281613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:38.281613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:38.281613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:38.281613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:38.281613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:38.281613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:38.282632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:38.282632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:38.282632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:38.282632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:38.282632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:38.282632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:38.282632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:38.282632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:38.282632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:38.282632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:38.282632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:38.282632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:38.282632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:38.282632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:38.282632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:38.282632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:38.282632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:38.283783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:38.283783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:38.283783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:38.283783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 327/660] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:38.283783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8dc36-2493-45f0-84d0-89b85f62f617 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:38.284906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9cf80-05ba-4fa9-a69e-bbff02993f73 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:38.320494 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:38.336008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfe6ee-6b0e-4d40-a137-b9c4a2377824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:38.336912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfe6ee-6b0e-4d40-a137-b9c4a2377824 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:38.337346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfe6ee-6b0e-4d40-a137-b9c4a2377824 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:38.337883 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfe6ee-6b0e-4d40-a137-b9c4a2377824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:38.416181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfe6ee-6b0e-4d40-a137-b9c4a2377824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:38.417327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8dc36-2493-45f0-84d0-89b85f62f617 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:38.417933 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfe6ee-6b0e-4d40-a137-b9c4a2377824 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:38.457522 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199fefb-b17d-4cae-8ec9-bed424237697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:38.458543 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199fefb-b17d-4cae-8ec9-bed424237697 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:38.458763 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199fefb-b17d-4cae-8ec9-bed424237697 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:38.459105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199fefb-b17d-4cae-8ec9-bed424237697 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:38.506475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:38.532802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199fefb-b17d-4cae-8ec9-bed424237697 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:38.537885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 334/661] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:12:38.538018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199fefb-b17d-4cae-8ec9-bed424237697 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:38.538128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfe6ee-6b0e-4d40-a137-b9c4a2377824 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:38.568164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:38.645353 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfe6ee-6b0e-4d40-a137-b9c4a2377824 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:38.646908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 328/662] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 16:12:38.652273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef4fa0-b7c5-4348-9b19-17d9ce5ac555 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:38.652273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef4fa0-b7c5-4348-9b19-17d9ce5ac555 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:38.652273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef4fa0-b7c5-4348-9b19-17d9ce5ac555 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:38.652273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 329/663] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:38.652273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef4fa0-b7c5-4348-9b19-17d9ce5ac555 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:38.693361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d29a2-bc1a-4631-92f9-94cac369a32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:38.694480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d29a2-bc1a-4631-92f9-94cac369a32f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:38.694851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d29a2-bc1a-4631-92f9-94cac369a32f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:38.695130 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d29a2-bc1a-4631-92f9-94cac369a32f None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:38.695791 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d29a2-bc1a-4631-92f9-94cac369a32f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:38.696115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d29a2-bc1a-4631-92f9-94cac369a32f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:38.697705 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d29a2-bc1a-4631-92f9-94cac369a32f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:38.709764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 335/664] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:38.709764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d29a2-bc1a-4631-92f9-94cac369a32f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:38.753313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:38.778298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef4fa0-b7c5-4348-9b19-17d9ce5ac555 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:38.808406 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:38.817835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95060302-370d-4371-8517-3b0f017f9013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:38.818492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95060302-370d-4371-8517-3b0f017f9013 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:38.818776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95060302-370d-4371-8517-3b0f017f9013 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:38.819046 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95060302-370d-4371-8517-3b0f017f9013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:38.825799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d29a2-bc1a-4631-92f9-94cac369a32f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:38.830759 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95060302-370d-4371-8517-3b0f017f9013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:38.832203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95060302-370d-4371-8517-3b0f017f9013 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:38.848443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-95060302-370d-4371-8517-3b0f017f9013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:38.848443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:38.848443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:38.848443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:38.848443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:38.848443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:38.848443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:38.848443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:38.848443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:38.848443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:38.848443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:38.848443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:38.848443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:38.848443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:38.848443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:38.848443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:38.849419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:38.849419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:38.849419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:38.849419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:38.849419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:38.849419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:38.849419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:38.849419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:38.849419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:38.849419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:38.849419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:38.849419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:38.849419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:38.849419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:38.849419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:38.849419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:38.849419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:38.850347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:38.850347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:38.850347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:38.850347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 330/665] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:38.851030 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becd5f0-1660-439e-b444-cd523668b0ca None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:38.851348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becd5f0-1660-439e-b444-cd523668b0ca None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:38.851577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becd5f0-1660-439e-b444-cd523668b0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:38.868657 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1917e7-81da-4e24-8506-e6db886e9723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:38.869293 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1917e7-81da-4e24-8506-e6db886e9723 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:38.869574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1917e7-81da-4e24-8506-e6db886e9723 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:38.869846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1917e7-81da-4e24-8506-e6db886e9723 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:38.870397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7becd5f0-1660-439e-b444-cd523668b0ca None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:38.871581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7becd5f0-1660-439e-b444-cd523668b0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:38.881058 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1917e7-81da-4e24-8506-e6db886e9723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:38.882562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1917e7-81da-4e24-8506-e6db886e9723 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:38.897163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-ab1917e7-81da-4e24-8506-e6db886e9723 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:38.897163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:38.897163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:38.897163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:38.897163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:38.897163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:38.897163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:38.897163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:38.897163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:38.897163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:38.897163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:38.897163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:38.897163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:38.897163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:38.897163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:38.897163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:38.898351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:38.898351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:38.898351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:38.898351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:38.898351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:38.898351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:38.898351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:38.898351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:38.898351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:38.898351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:38.898351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:38.898351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:38.898351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:38.898351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:38.898351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:38.898351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:38.898351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:38.900221 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:38.900221 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:38.900221 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:38.900221 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 336/666] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:38.900221 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1917e7-81da-4e24-8506-e6db886e9723 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:38.953861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 331/667] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:38.955125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7becd5f0-1660-439e-b444-cd523668b0ca None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:39.012153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:39.026948 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1917e7-81da-4e24-8506-e6db886e9723 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:39.076191 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ca37a-2889-4d43-9ed1-3e1d22f78048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:39.076748 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7becd5f0-1660-439e-b444-cd523668b0ca None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:39.076881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ca37a-2889-4d43-9ed1-3e1d22f78048 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:39.077099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ca37a-2889-4d43-9ed1-3e1d22f78048 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:39.077363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ca37a-2889-4d43-9ed1-3e1d22f78048 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:39.085966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ca37a-2889-4d43-9ed1-3e1d22f78048 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:39.087708 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ca37a-2889-4d43-9ed1-3e1d22f78048 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:39.088574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:39.106862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-9d7ca37a-2889-4d43-9ed1-3e1d22f78048 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:39.106862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:39.106862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:39.106862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:39.106862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:39.106862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:39.106862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:39.106862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:39.106862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:39.106862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:39.106862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:39.106862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:39.106862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:39.106862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:39.106862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:39.107830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:39.107830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:39.107830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:39.107830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:39.107830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:39.107830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:39.107830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:39.107830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:39.107830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:39.107830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:39.107830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:39.107830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:39.107830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:39.107830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:39.107830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:39.107830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:39.107830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:39.109311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:39.109311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:39.109311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:39.109311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:39.109311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:39.109311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:39.109311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:39.109311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:39.109311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 337/668] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:39.109311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ca37a-2889-4d43-9ed1-3e1d22f78048 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:39.121847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd147e-27fd-414c-bda2-e71b64e1769f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:39.122936 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd147e-27fd-414c-bda2-e71b64e1769f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:39.123416 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd147e-27fd-414c-bda2-e71b64e1769f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:39.123919 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd147e-27fd-414c-bda2-e71b64e1769f None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:39.124876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd147e-27fd-414c-bda2-e71b64e1769f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:39.125382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd147e-27fd-414c-bda2-e71b64e1769f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:39.127251 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd147e-27fd-414c-bda2-e71b64e1769f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:39.145760 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 332/669] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:39.145760 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd147e-27fd-414c-bda2-e71b64e1769f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:39.231805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ca37a-2889-4d43-9ed1-3e1d22f78048 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:39.261497 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd147e-27fd-414c-bda2-e71b64e1769f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:39.269071 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d6dad-c1b9-4756-9633-18ee8d44efdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:39.269671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d6dad-c1b9-4756-9633-18ee8d44efdc None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:39.269948 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d6dad-c1b9-4756-9633-18ee8d44efdc None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:39.270250 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d6dad-c1b9-4756-9633-18ee8d44efdc None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:39.270891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d6dad-c1b9-4756-9633-18ee8d44efdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:39.271188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d6dad-c1b9-4756-9633-18ee8d44efdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:39.272540 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d6dad-c1b9-4756-9633-18ee8d44efdc None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:39.284871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 338/670] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:39.286031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6387e-6873-4a78-bef1-a7d8846c2f23 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:39.286338 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6387e-6873-4a78-bef1-a7d8846c2f23 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:39.286613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6387e-6873-4a78-bef1-a7d8846c2f23 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:39.287784 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 339/671] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:39.288468 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6387e-6873-4a78-bef1-a7d8846c2f23 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:39.297887 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5991e04-6d77-4d33-8b21-c84702696431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:39.298523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5991e04-6d77-4d33-8b21-c84702696431 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:39.298804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5991e04-6d77-4d33-8b21-c84702696431 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:39.299077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5991e04-6d77-4d33-8b21-c84702696431 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:39.299766 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5991e04-6d77-4d33-8b21-c84702696431 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:39.300074 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5991e04-6d77-4d33-8b21-c84702696431 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:39.300721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:39.301495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5991e04-6d77-4d33-8b21-c84702696431 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:39.314317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 333/672] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:39.315121 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5991e04-6d77-4d33-8b21-c84702696431 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:39.343831 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:39.393401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6387e-6873-4a78-bef1-a7d8846c2f23 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:39.415301 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5991e04-6d77-4d33-8b21-c84702696431 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:39.426980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478090b-3373-483c-8dbd-37b2eb07e3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:39.427598 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478090b-3373-483c-8dbd-37b2eb07e3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:39.427867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478090b-3373-483c-8dbd-37b2eb07e3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:39.428138 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478090b-3373-483c-8dbd-37b2eb07e3e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:39.435383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478090b-3373-483c-8dbd-37b2eb07e3e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:39.436805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478090b-3373-483c-8dbd-37b2eb07e3e2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:39.448285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-b478090b-3373-483c-8dbd-37b2eb07e3e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:39.448285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:39.448285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:39.448285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:39.448285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:39.448285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:39.448285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:39.448285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:39.448285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:39.448285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:39.448285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:39.448285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:39.448285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:39.448285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:39.448285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:39.449323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:39.449323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:39.449323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:39.449323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:39.449323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:39.449323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:39.449323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:39.449323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:39.449323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:39.449323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:39.449323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:39.449323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:39.449323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:39.449323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:39.449323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:39.449323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:39.449323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:39.450459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:39.450459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:39.450459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:39.450459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:39.450459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:39.450459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:39.450459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:39.450459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:39.450459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 340/673] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:39.452725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acb1b6-677b-4f29-ab48-2a9c77b47497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:39.453355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acb1b6-677b-4f29-ab48-2a9c77b47497 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:39.453689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acb1b6-677b-4f29-ab48-2a9c77b47497 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:39.453972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acb1b6-677b-4f29-ab48-2a9c77b47497 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:39.454860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478090b-3373-483c-8dbd-37b2eb07e3e2 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:39.464333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acb1b6-677b-4f29-ab48-2a9c77b47497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:39.468978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-65acb1b6-677b-4f29-ab48-2a9c77b47497 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:12:39.468978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:39.468978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:39.468978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:39.468978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:39.468978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:39.468978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:39.468978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:39.468978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:39.468978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:39.468978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:39.468978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:39.468978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:39.468978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:39.468978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:39.468978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:39.470083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:39.470083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:39.470083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:39.470083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:39.470083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:39.470083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:39.470083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:39.470083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:39.470083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:39.470083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:39.470083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:39.470083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:39.470083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:39.470083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:39.470083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:39.470083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:39.470964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:39.470964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:39.470964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:39.470964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:39.470964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:39.470964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:39.470964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:39.470964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:39.470964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:39.470964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:39.470964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:12:39.470964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:39.470964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 334/674] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:12:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:39.471671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b662e-5d5f-442c-b7e6-9195046f8dd7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:39.471773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b662e-5d5f-442c-b7e6-9195046f8dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:39.472099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b662e-5d5f-442c-b7e6-9195046f8dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:39.489955 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9f8b662e-5d5f-442c-b7e6-9195046f8dd7 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:39.491104 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9f8b662e-5d5f-442c-b7e6-9195046f8dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:39.522768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:39.558983 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478090b-3373-483c-8dbd-37b2eb07e3e2 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:39.559499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 335/675] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:39.560333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b662e-5d5f-442c-b7e6-9195046f8dd7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:39.579458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:39.616738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47314880-e987-4ce7-a638-cdd21cc94f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:39.617520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47314880-e987-4ce7-a638-cdd21cc94f48 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:39.617804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47314880-e987-4ce7-a638-cdd21cc94f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:39.619015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47314880-e987-4ce7-a638-cdd21cc94f48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:39.627739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47314880-e987-4ce7-a638-cdd21cc94f48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:39.629648 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47314880-e987-4ce7-a638-cdd21cc94f48 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:39.644631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-47314880-e987-4ce7-a638-cdd21cc94f48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:39.644631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:39.644631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:39.644631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:39.644631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:39.644631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:39.644631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:39.644631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:39.644631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:39.644631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:39.644631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:39.644631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:39.644631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:39.644631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:39.644631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:39.645738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:39.645738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:39.645738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:39.645738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:39.645738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:39.645738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:39.645738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:39.645738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:39.645738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:39.645738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:39.645738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:39.645738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:39.645738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:39.645738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:39.645738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:39.645738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:39.645738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:39.646678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:39.646678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:39.646678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:39.646678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:39.646678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:39.646678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:39.646678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:39.646678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:39.646678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 341/676] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:39.647157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47314880-e987-4ce7-a638-cdd21cc94f48 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:39.672612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b662e-5d5f-442c-b7e6-9195046f8dd7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:39.713116 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01409ada-d2e2-4b61-9456-e747e30285e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:39.713724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01409ada-d2e2-4b61-9456-e747e30285e2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:39.714008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01409ada-d2e2-4b61-9456-e747e30285e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:39.714312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01409ada-d2e2-4b61-9456-e747e30285e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:39.715047 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01409ada-d2e2-4b61-9456-e747e30285e2 None admin] RBAC: Adding query filter params (role.id=bbf63b75406649a3b653308ecb75062d, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=d3ddab91bbb24d119dd302024f458d35) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:39.715355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01409ada-d2e2-4b61-9456-e747e30285e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:39.716780 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01409ada-d2e2-4b61-9456-e747e30285e2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:39.722744 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 336/677] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:12:39 2022] GET /identity/v3/role_assignments?user.id=d3ddab91bbb24d119dd302024f458d35&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=bbf63b75406649a3b653308ecb75062d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:39.727023 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01409ada-d2e2-4b61-9456-e747e30285e2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:39.758821 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47314880-e987-4ce7-a638-cdd21cc94f48 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:39.793538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:39.804493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8c4b9-0e9d-4a70-a794-88a532c85167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:39.805497 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8c4b9-0e9d-4a70-a794-88a532c85167 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:39.806548 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8c4b9-0e9d-4a70-a794-88a532c85167 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:39.807023 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8c4b9-0e9d-4a70-a794-88a532c85167 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:39.807980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8c4b9-0e9d-4a70-a794-88a532c85167 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:39.808543 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8c4b9-0e9d-4a70-a794-88a532c85167 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:39.810364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8c4b9-0e9d-4a70-a794-88a532c85167 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:39.825614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 342/678] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:39.826996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8c4b9-0e9d-4a70-a794-88a532c85167 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:39.849917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:39.874271 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01409ada-d2e2-4b61-9456-e747e30285e2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:39.917157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1e75a-82b8-446c-9748-1bc8f66417f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:39.917775 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1e75a-82b8-446c-9748-1bc8f66417f8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:39.918141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1e75a-82b8-446c-9748-1bc8f66417f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:39.918367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1e75a-82b8-446c-9748-1bc8f66417f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:39.919092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1e75a-82b8-446c-9748-1bc8f66417f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:39.919404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1e75a-82b8-446c-9748-1bc8f66417f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:39.920788 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1e75a-82b8-446c-9748-1bc8f66417f8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:39.929973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 337/679] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:39.931194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1e75a-82b8-446c-9748-1bc8f66417f8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:39.945891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8c4b9-0e9d-4a70-a794-88a532c85167 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:39.985435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3c549-6623-4a05-825a-a82aeb275432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:39.986042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3c549-6623-4a05-825a-a82aeb275432 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:39.986353 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3c549-6623-4a05-825a-a82aeb275432 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:39.986625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3c549-6623-4a05-825a-a82aeb275432 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:39.987319 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3c549-6623-4a05-825a-a82aeb275432 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:39.987625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3c549-6623-4a05-825a-a82aeb275432 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:39.989049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3c549-6623-4a05-825a-a82aeb275432 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:40.001368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 343/680] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:40.002223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3c549-6623-4a05-825a-a82aeb275432 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:40.047861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1e75a-82b8-446c-9748-1bc8f66417f8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:40.056972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:40.087490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bd675-5da7-4667-9645-6e903b3c27b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:40.088169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bd675-5da7-4667-9645-6e903b3c27b1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:40.088444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bd675-5da7-4667-9645-6e903b3c27b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:40.088713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bd675-5da7-4667-9645-6e903b3c27b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:40.089963 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bd675-5da7-4667-9645-6e903b3c27b1 None admin] RBAC: Adding query filter params (role.id=bbf63b75406649a3b653308ecb75062d, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=9eae00506f75402fbf972a8991ad0a68) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:40.090484 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bd675-5da7-4667-9645-6e903b3c27b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:40.091546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bd675-5da7-4667-9645-6e903b3c27b1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:40.106110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 338/681] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:12:39 2022] GET /identity/v3/role_assignments?user.id=9eae00506f75402fbf972a8991ad0a68&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=bbf63b75406649a3b653308ecb75062d => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:40.106110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bd675-5da7-4667-9645-6e903b3c27b1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:40.112118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3c549-6623-4a05-825a-a82aeb275432 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:40.122591 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:40.171872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431bea3-942b-43f3-bce6-b0d932eab9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:40.173024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431bea3-942b-43f3-bce6-b0d932eab9bf None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:40.174134 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431bea3-942b-43f3-bce6-b0d932eab9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:40.174502 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431bea3-942b-43f3-bce6-b0d932eab9bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:40.192027 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431bea3-942b-43f3-bce6-b0d932eab9bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:40.197864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-c431bea3-942b-43f3-bce6-b0d932eab9bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:40.197864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:40.197864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:40.197864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:40.197864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:40.197864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:40.197864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:40.197864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:40.197864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:40.197864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:40.197864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:40.197864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:40.197864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:40.197864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:40.197864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:40.197864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:40.199109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:40.199109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:40.199109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:40.199109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:40.199109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:40.199109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:40.199109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:40.199109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:40.199109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:40.199109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:40.199109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:40.199109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:40.199109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:40.199109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:40.199109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:40.199109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:40.200140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:40.200140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:40.200140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:40.200140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:40.200140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:40.200140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:40.200140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:40.200140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:40.200140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:40.200140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:40.200140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:40.200140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:40.201815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 344/682] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:40.207817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431bea3-942b-43f3-bce6-b0d932eab9bf None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:40.252995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bd675-5da7-4667-9645-6e903b3c27b1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:40.296844 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c94b2-d326-4642-9fb6-e51151eb07ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:40.297484 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c94b2-d326-4642-9fb6-e51151eb07ba None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:40.297772 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c94b2-d326-4642-9fb6-e51151eb07ba None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:40.298139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c94b2-d326-4642-9fb6-e51151eb07ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:40.312210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c94b2-d326-4642-9fb6-e51151eb07ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:40.314230 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c94b2-d326-4642-9fb6-e51151eb07ba None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:40.331181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-557c94b2-d326-4642-9fb6-e51151eb07ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:40.331181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:40.331181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:40.331181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:40.331181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:40.331181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:40.331181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:40.331181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:40.331181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:40.331181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:40.331181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:40.331181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:40.331181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:40.331181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:40.331181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:40.331181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:40.332457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:40.332457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:40.332457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:40.332457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:40.332457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:40.332457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:40.332457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:40.332457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:40.332457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:40.332457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:40.332457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:40.332457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:40.332457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:40.332457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:40.332457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:40.332457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:40.332457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:40.333630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:40.333630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:40.333630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:40.333877 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431bea3-942b-43f3-bce6-b0d932eab9bf None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:40.334254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 339/683] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:40.335239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c94b2-d326-4642-9fb6-e51151eb07ba None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:40.348570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:40.385085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59098f-5a56-4a53-8844-7087054c884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:40.385859 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59098f-5a56-4a53-8844-7087054c884b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:40.386263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59098f-5a56-4a53-8844-7087054c884b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:40.386622 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59098f-5a56-4a53-8844-7087054c884b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:40.387497 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59098f-5a56-4a53-8844-7087054c884b None admin] RBAC: Adding query filter params (role.id=bbf63b75406649a3b653308ecb75062d, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=8ffa4002b4b24e6e9665dc349ad2f1b6) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:40.387972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59098f-5a56-4a53-8844-7087054c884b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:40.389488 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59098f-5a56-4a53-8844-7087054c884b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:40.396307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 345/684] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:12:40 2022] GET /identity/v3/role_assignments?user.id=8ffa4002b4b24e6e9665dc349ad2f1b6&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=bbf63b75406649a3b653308ecb75062d => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:40.397373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59098f-5a56-4a53-8844-7087054c884b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:40.423185 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:40.502476 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c94b2-d326-4642-9fb6-e51151eb07ba None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:40.542444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e637b23-1c8b-42e4-84ec-fd1d7cd7b842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:40.543631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e637b23-1c8b-42e4-84ec-fd1d7cd7b842 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:40.544105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e637b23-1c8b-42e4-84ec-fd1d7cd7b842 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:40.544710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e637b23-1c8b-42e4-84ec-fd1d7cd7b842 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:40.545594 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e637b23-1c8b-42e4-84ec-fd1d7cd7b842 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:40.546128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e637b23-1c8b-42e4-84ec-fd1d7cd7b842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:40.547816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e637b23-1c8b-42e4-84ec-fd1d7cd7b842 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:40.557964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 340/685] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:40.564140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e637b23-1c8b-42e4-84ec-fd1d7cd7b842 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:40.619572 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59098f-5a56-4a53-8844-7087054c884b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:40.669567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a96f2-a2f9-418a-9a81-c479f1b70ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:40.670450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a96f2-a2f9-418a-9a81-c479f1b70ddc None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:40.670737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a96f2-a2f9-418a-9a81-c479f1b70ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:40.671013 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a96f2-a2f9-418a-9a81-c479f1b70ddc None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:40.672091 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a96f2-a2f9-418a-9a81-c479f1b70ddc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:40.672467 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a96f2-a2f9-418a-9a81-c479f1b70ddc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:40.674413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a96f2-a2f9-418a-9a81-c479f1b70ddc None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:40.681363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e637b23-1c8b-42e4-84ec-fd1d7cd7b842 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:40.691300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 346/686] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:40.697678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a96f2-a2f9-418a-9a81-c479f1b70ddc None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:40.710573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:40.731717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108254ed-9888-4ae9-9e84-c50a5ce918df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:40.732367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108254ed-9888-4ae9-9e84-c50a5ce918df None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:40.732902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108254ed-9888-4ae9-9e84-c50a5ce918df None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:40.733186 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108254ed-9888-4ae9-9e84-c50a5ce918df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:40.741441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:40.749902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108254ed-9888-4ae9-9e84-c50a5ce918df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:40.751399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108254ed-9888-4ae9-9e84-c50a5ce918df None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:40.771523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-108254ed-9888-4ae9-9e84-c50a5ce918df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:40.771523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:40.771523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:40.771523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:40.771523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:40.771523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:40.771523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:40.771523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:40.771523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:40.771523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:40.771523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:40.771523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:40.771523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:40.771523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:40.771523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:40.771523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:40.772697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:40.772697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:40.772697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:40.772697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:40.772697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:40.772697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:40.772697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:40.772697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:40.772697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:40.772697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:40.772697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:40.772697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:40.772697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:40.772697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:40.772697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:40.772697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:40.772697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:40.773768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:40.773768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:40.773768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:40.773768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 341/687] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:12:40.781369 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108254ed-9888-4ae9-9e84-c50a5ce918df None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:40.841649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a96f2-a2f9-418a-9a81-c479f1b70ddc None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:40.898945 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b9e80-a8ee-44c2-ba00-7416cfd0cb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:40.900026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b9e80-a8ee-44c2-ba00-7416cfd0cb66 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:40.900312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b9e80-a8ee-44c2-ba00-7416cfd0cb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:40.900586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b9e80-a8ee-44c2-ba00-7416cfd0cb66 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:40.909565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b9e80-a8ee-44c2-ba00-7416cfd0cb66 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:40.911582 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b9e80-a8ee-44c2-ba00-7416cfd0cb66 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:40.924790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-183b9e80-a8ee-44c2-ba00-7416cfd0cb66 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:12:40.924790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:40.924790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:40.924790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:40.924790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:40.924790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:40.924790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:40.924790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:40.924790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:40.924790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:40.924790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:40.924790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:40.924790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:40.924790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:40.924790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:40.924790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:40.925736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:40.925736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:40.925736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:40.925736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:40.925736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:40.925736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:40.925736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:40.925736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:40.925736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:40.925736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:40.925736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:40.925736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:40.925736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:40.925736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:40.925736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:40.925736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:40.925736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:40.925736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:40.926690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:40.926690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:40.926690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:40.926690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:40.926690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:40.926690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:40.926690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:40.926690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:40.926690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:12:40.926690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:40.929732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 347/688] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 23 16:12:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:40.932604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b9e80-a8ee-44c2-ba00-7416cfd0cb66 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:40.956181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108254ed-9888-4ae9-9e84-c50a5ce918df None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:41.040517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:41.050503 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b9e80-a8ee-44c2-ba00-7416cfd0cb66 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:41.071514 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d164b-4266-424c-bf36-1181b1611225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:41.072143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d164b-4266-424c-bf36-1181b1611225 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:41.072426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d164b-4266-424c-bf36-1181b1611225 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:41.072707 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d164b-4266-424c-bf36-1181b1611225 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:41.073359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d164b-4266-424c-bf36-1181b1611225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:41.073663 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d164b-4266-424c-bf36-1181b1611225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:41.075062 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d164b-4266-424c-bf36-1181b1611225 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:41.091182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b08f47-3e45-4716-94f6-5ba14d16db20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:41.091894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b08f47-3e45-4716-94f6-5ba14d16db20 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:41.092126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b08f47-3e45-4716-94f6-5ba14d16db20 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:41.092404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b08f47-3e45-4716-94f6-5ba14d16db20 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:41.093139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b08f47-3e45-4716-94f6-5ba14d16db20 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:41.093449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b08f47-3e45-4716-94f6-5ba14d16db20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:41.094930 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b08f47-3e45-4716-94f6-5ba14d16db20 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:41.097447 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 342/689] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:41.102967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d164b-4266-424c-bf36-1181b1611225 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:41.114950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 348/690] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 23 16:12:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:41.121913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b08f47-3e45-4716-94f6-5ba14d16db20 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:41.204471 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:41.286199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d164b-4266-424c-bf36-1181b1611225 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:41.326479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb555e0-4c49-48ca-a8c1-5d0aefcdd819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:41.327119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb555e0-4c49-48ca-a8c1-5d0aefcdd819 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:41.327401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb555e0-4c49-48ca-a8c1-5d0aefcdd819 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:41.327678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb555e0-4c49-48ca-a8c1-5d0aefcdd819 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:41.327790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b08f47-3e45-4716-94f6-5ba14d16db20 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:41.336402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb555e0-4c49-48ca-a8c1-5d0aefcdd819 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:41.338269 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb555e0-4c49-48ca-a8c1-5d0aefcdd819 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:41.371404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-ddb555e0-4c49-48ca-a8c1-5d0aefcdd819 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:12:41.371404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:41.371404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:41.371404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:41.371404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:41.371404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:41.371404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:41.371404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:41.371404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:41.371404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:41.371404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:41.371404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:41.371404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:41.371404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:41.371404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:41.371404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:41.372373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:41.372373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:41.372373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:41.372373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:41.372373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:41.372373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:41.372373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:41.372373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:41.372373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:41.372373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:41.372373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:41.372373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:41.372373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:41.372373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:41.372373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:41.372373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:41.372373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:41.372373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:41.373665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:41.373665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:41.373665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:41.373665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:41.373665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:41.373665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:41.373665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:41.373665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:41.373665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:12:41.373665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:41.373665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 343/691] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:12:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:12:41.390900 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb555e0-4c49-48ca-a8c1-5d0aefcdd819 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:41.407730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ed92d-217c-45d5-909c-abd4e64f3883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:41.408356 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ed92d-217c-45d5-909c-abd4e64f3883 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:41.408901 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ed92d-217c-45d5-909c-abd4e64f3883 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:41.409179 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ed92d-217c-45d5-909c-abd4e64f3883 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:41.454521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:41.500862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ed92d-217c-45d5-909c-abd4e64f3883 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:41.502509 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ed92d-217c-45d5-909c-abd4e64f3883 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:41.612585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:41.617077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 349/692] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 16:12:41.623110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb555e0-4c49-48ca-a8c1-5d0aefcdd819 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:41.625210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ed92d-217c-45d5-909c-abd4e64f3883 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:41.696858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2f514-cef4-4cba-923a-1ab5da524292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:41.697510 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2f514-cef4-4cba-923a-1ab5da524292 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:41.697797 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2f514-cef4-4cba-923a-1ab5da524292 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:41.698094 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2f514-cef4-4cba-923a-1ab5da524292 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:41.698846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2f514-cef4-4cba-923a-1ab5da524292 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:41.699159 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2f514-cef4-4cba-923a-1ab5da524292 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:41.700597 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2f514-cef4-4cba-923a-1ab5da524292 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:41.726490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:41.740351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 344/693] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 23 16:12:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:41.752661 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2f514-cef4-4cba-923a-1ab5da524292 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:41.783308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ed92d-217c-45d5-909c-abd4e64f3883 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:41.820420 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42445ced-3cdd-49ac-af7c-b96ab2758187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:41.821053 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42445ced-3cdd-49ac-af7c-b96ab2758187 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:41.821530 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42445ced-3cdd-49ac-af7c-b96ab2758187 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:41.821884 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42445ced-3cdd-49ac-af7c-b96ab2758187 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:41.832853 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42445ced-3cdd-49ac-af7c-b96ab2758187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:41.834568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42445ced-3cdd-49ac-af7c-b96ab2758187 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:41.850970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-42445ced-3cdd-49ac-af7c-b96ab2758187 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:41.850970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:41.850970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:41.850970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:41.850970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:41.850970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:41.850970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:41.850970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:41.850970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:41.850970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:41.850970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:41.850970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:41.850970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:41.850970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:41.850970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:41.850970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:41.852990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:41.852990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:41.852990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:41.852990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:41.852990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:41.852990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:41.852990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:41.852990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:41.852990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:41.852990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:41.852990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:41.852990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:41.852990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:41.852990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:41.852990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:41.852990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:41.852990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:41.853918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:41.853918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:41.853918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:41.857566 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 350/694] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:41.858975 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42445ced-3cdd-49ac-af7c-b96ab2758187 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:41.896755 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2f514-cef4-4cba-923a-1ab5da524292 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:41.933372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effe0aa-f4cc-42ad-9848-0646df53f1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:41.934415 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effe0aa-f4cc-42ad-9848-0646df53f1ac None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:41.934913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effe0aa-f4cc-42ad-9848-0646df53f1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:41.935408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effe0aa-f4cc-42ad-9848-0646df53f1ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:41.959256 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:41.972966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42445ced-3cdd-49ac-af7c-b96ab2758187 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:42.002763 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:42.009924 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effe0aa-f4cc-42ad-9848-0646df53f1ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:42.011212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17470ce7-4ed8-4ca1-bdd8-934e46ca5803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:42.011831 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17470ce7-4ed8-4ca1-bdd8-934e46ca5803 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:42.012113 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17470ce7-4ed8-4ca1-bdd8-934e46ca5803 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:42.012392 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17470ce7-4ed8-4ca1-bdd8-934e46ca5803 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:42.012662 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effe0aa-f4cc-42ad-9848-0646df53f1ac None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:42.013042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17470ce7-4ed8-4ca1-bdd8-934e46ca5803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:42.013349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17470ce7-4ed8-4ca1-bdd8-934e46ca5803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:42.014739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17470ce7-4ed8-4ca1-bdd8-934e46ca5803 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:42.033101 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 351/695] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:42.034786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2804ce8-8c70-49d0-93b3-64889d3100fc None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:42.035078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2804ce8-8c70-49d0-93b3-64889d3100fc None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:42.035359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2804ce8-8c70-49d0-93b3-64889d3100fc None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:42.037244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 352/696] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:42.038273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2804ce8-8c70-49d0-93b3-64889d3100fc None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:42.119210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 345/697] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 16:12:42.120854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8d126-fd46-4650-9dd7-2afdf5ea65fc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:42.121280 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8d126-fd46-4650-9dd7-2afdf5ea65fc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:42.121676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8d126-fd46-4650-9dd7-2afdf5ea65fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:42.140127 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-63c8d126-fd46-4650-9dd7-2afdf5ea65fc None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:42.141618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-63c8d126-fd46-4650-9dd7-2afdf5ea65fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:42.155155 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2804ce8-8c70-49d0-93b3-64889d3100fc None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:42.192652 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:42.205588 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff61038-b532-4b88-9b31-9981526be7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:42.206704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff61038-b532-4b88-9b31-9981526be7cc None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:42.207188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff61038-b532-4b88-9b31-9981526be7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:42.207681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff61038-b532-4b88-9b31-9981526be7cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:42.216067 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff61038-b532-4b88-9b31-9981526be7cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:42.216857 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 346/698] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:42.217773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8d126-fd46-4650-9dd7-2afdf5ea65fc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:42.218583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff61038-b532-4b88-9b31-9981526be7cc None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:42.231871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-0ff61038-b532-4b88-9b31-9981526be7cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:42.231871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:42.231871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:42.231871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:42.231871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:42.231871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:42.231871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:42.231871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:42.231871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:42.231871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:42.231871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:42.231871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:42.231871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:42.231871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:42.231871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:42.232793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:42.232793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:42.232793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:42.232793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:42.232793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:42.232793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:42.232793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:42.232793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:42.232793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:42.232793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:42.232793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:42.232793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:42.232793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:42.232793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:42.232793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:42.232793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:42.232793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:42.233714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:42.233714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:42.233714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:42.233714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:42.233714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:42.233714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:42.233714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:42.233714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:42.240728 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 353/699] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:42.242303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff61038-b532-4b88-9b31-9981526be7cc None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:42.278531 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:42.355206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff61038-b532-4b88-9b31-9981526be7cc None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:42.394604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8d126-fd46-4650-9dd7-2afdf5ea65fc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:42.397525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e40c1-1cd7-4e03-9148-61a2aea9486b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:42.399007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e40c1-1cd7-4e03-9148-61a2aea9486b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:42.400268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e40c1-1cd7-4e03-9148-61a2aea9486b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:42.400758 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e40c1-1cd7-4e03-9148-61a2aea9486b None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:42.401688 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e40c1-1cd7-4e03-9148-61a2aea9486b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:42.402229 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e40c1-1cd7-4e03-9148-61a2aea9486b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:42.404101 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e40c1-1cd7-4e03-9148-61a2aea9486b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:42.422606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 354/700] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:42.424752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e40c1-1cd7-4e03-9148-61a2aea9486b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:42.462867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b975b6f-a5b9-4fb1-a703-3ecfd47799e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:42.463555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b975b6f-a5b9-4fb1-a703-3ecfd47799e2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:42.464745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b975b6f-a5b9-4fb1-a703-3ecfd47799e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:42.465042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b975b6f-a5b9-4fb1-a703-3ecfd47799e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:42.477432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b975b6f-a5b9-4fb1-a703-3ecfd47799e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:42.479416 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b975b6f-a5b9-4fb1-a703-3ecfd47799e2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:42.499600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-9b975b6f-a5b9-4fb1-a703-3ecfd47799e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:42.499600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:42.499600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:42.499600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:42.499600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:42.499600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:42.499600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:42.499600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:42.499600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:42.499600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:42.499600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:42.499600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:42.499600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:42.499600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:42.499600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:42.499600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:42.500649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:42.500649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:42.500649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:42.500649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:42.500649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:42.500649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:42.500649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:42.500649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:42.500649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:42.500649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:42.500649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:42.500649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:42.500649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:42.500649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:42.500649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:42.500649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:42.500649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:42.501614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:42.501614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:42.501614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:42.506220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 347/701] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:42.507716 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c05719-ae17-4aca-a98e-a8fb99895ece None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:42.508475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c05719-ae17-4aca-a98e-a8fb99895ece None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:42.509533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c05719-ae17-4aca-a98e-a8fb99895ece None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:42.512239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 348/702] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:42.513190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c05719-ae17-4aca-a98e-a8fb99895ece None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:42.531118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:42.550765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e40c1-1cd7-4e03-9148-61a2aea9486b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:42.560611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:42.588249 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fb235-db9b-4711-8c90-93430622519d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:42.589314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fb235-db9b-4711-8c90-93430622519d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:42.589821 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fb235-db9b-4711-8c90-93430622519d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:42.590421 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fb235-db9b-4711-8c90-93430622519d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:42.591367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fb235-db9b-4711-8c90-93430622519d None admin] RBAC: Adding query filter params (role.id=8de0c87242d7426ea25a510b578c02aa, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=767ca33ca8e244f8a0cc773e3b6abefb) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:42.591896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fb235-db9b-4711-8c90-93430622519d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:42.593531 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fb235-db9b-4711-8c90-93430622519d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:42.599843 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 355/703] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:12:42 2022] GET /identity/v3/role_assignments?user.id=767ca33ca8e244f8a0cc773e3b6abefb&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=8de0c87242d7426ea25a510b578c02aa => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:42.601248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88babfc-1a7f-4ce0-803d-564b4c2d2600 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:42.601778 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88babfc-1a7f-4ce0-803d-564b4c2d2600 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:42.602326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88babfc-1a7f-4ce0-803d-564b4c2d2600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:42.623457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-d88babfc-1a7f-4ce0-803d-564b4c2d2600 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:42.625076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d88babfc-1a7f-4ce0-803d-564b4c2d2600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:42.643708 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c05719-ae17-4aca-a98e-a8fb99895ece None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:42.701015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cea53-9ce4-4a71-923d-dd9a1b4b7cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:42.702429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cea53-9ce4-4a71-923d-dd9a1b4b7cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:42.702867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cea53-9ce4-4a71-923d-dd9a1b4b7cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:42.703289 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cea53-9ce4-4a71-923d-dd9a1b4b7cf1 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:42.704118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cea53-9ce4-4a71-923d-dd9a1b4b7cf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:42.704594 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cea53-9ce4-4a71-923d-dd9a1b4b7cf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:42.706885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cea53-9ce4-4a71-923d-dd9a1b4b7cf1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:42.722211 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 356/704] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:42.723283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88babfc-1a7f-4ce0-803d-564b4c2d2600 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:42.725240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 349/705] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:42.744187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cea53-9ce4-4a71-923d-dd9a1b4b7cf1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:42.815522 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:42.843045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88babfc-1a7f-4ce0-803d-564b4c2d2600 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:42.883192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bab99-9330-49dd-bfc8-5de3b6f6ff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:42.883854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bab99-9330-49dd-bfc8-5de3b6f6ff49 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:42.884145 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bab99-9330-49dd-bfc8-5de3b6f6ff49 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:42.884478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bab99-9330-49dd-bfc8-5de3b6f6ff49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:42.888576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:42.895813 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cea53-9ce4-4a71-923d-dd9a1b4b7cf1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:42.896098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bab99-9330-49dd-bfc8-5de3b6f6ff49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:42.897620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bab99-9330-49dd-bfc8-5de3b6f6ff49 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:42.914560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-706bab99-9330-49dd-bfc8-5de3b6f6ff49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:42.914560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:42.914560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:42.914560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:42.914560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:42.914560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:42.914560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:42.914560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:42.914560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:42.914560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:42.914560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:42.914560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:42.914560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:42.914560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:42.914560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:42.914560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:42.916157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:42.916157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:42.916157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:42.916157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:42.916157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:42.916157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:42.916157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:42.916157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:42.916157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:42.916157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:42.916157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:42.916157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:42.916157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:42.916157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:42.916157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:42.916157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:42.916157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:42.917034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:42.917034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:42.917034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:42.917214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 357/706] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:42.918371 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d1f48-557c-4e39-8e6c-0c0b66838e20 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:42.918859 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d1f48-557c-4e39-8e6c-0c0b66838e20 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:42.919146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d1f48-557c-4e39-8e6c-0c0b66838e20 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:42.924910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 358/707] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:42.926134 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d1f48-557c-4e39-8e6c-0c0b66838e20 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:42.933490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9f4ff-f6f7-46ae-a1fb-fa099544fd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:42.934274 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9f4ff-f6f7-46ae-a1fb-fa099544fd47 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:42.934668 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9f4ff-f6f7-46ae-a1fb-fa099544fd47 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:42.935041 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9f4ff-f6f7-46ae-a1fb-fa099544fd47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:42.942099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9f4ff-f6f7-46ae-a1fb-fa099544fd47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:42.943623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9f4ff-f6f7-46ae-a1fb-fa099544fd47 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:42.955735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-36c9f4ff-f6f7-46ae-a1fb-fa099544fd47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:42.955735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:42.955735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:42.955735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:42.955735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:42.955735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:42.955735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:42.955735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:42.955735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:42.955735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:42.955735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:42.955735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:42.955735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:42.955735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:42.955735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:42.956792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:42.956792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:42.956792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:42.956792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:42.956792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:42.956792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:42.956792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:42.956792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:42.956792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:42.956792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:42.956792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:42.956792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:42.956792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:42.956792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:42.956792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:42.956792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:42.956792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:42.957882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:42.957882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:42.957882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:42.957882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:42.957882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:42.957882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:42.957882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:42.957882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:42.959463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 350/708] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:12:42.960721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08c267-282c-4b04-b9ac-e78409db4f4e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:42.961100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08c267-282c-4b04-b9ac-e78409db4f4e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:42.961466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08c267-282c-4b04-b9ac-e78409db4f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:42.980916 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1c08c267-282c-4b04-b9ac-e78409db4f4e None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:42.982318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1c08c267-282c-4b04-b9ac-e78409db4f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:43.043221 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d1f48-557c-4e39-8e6c-0c0b66838e20 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:43.054655 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 351/709] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:43.056488 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08c267-282c-4b04-b9ac-e78409db4f4e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:43.083349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:43.096538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c9956-2d34-4976-8783-affffd7c77f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:43.097450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c9956-2d34-4976-8783-affffd7c77f1 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:43.097910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c9956-2d34-4976-8783-affffd7c77f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:43.098379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c9956-2d34-4976-8783-affffd7c77f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:43.099227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c9956-2d34-4976-8783-affffd7c77f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:43.099715 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c9956-2d34-4976-8783-affffd7c77f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:43.101800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c9956-2d34-4976-8783-affffd7c77f1 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:43.117525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 359/710] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:43.119356 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c9956-2d34-4976-8783-affffd7c77f1 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:43.148664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:43.165991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08c267-282c-4b04-b9ac-e78409db4f4e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:43.203605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdb08e-f9a3-447d-8e72-9eadb2bd9cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:43.204406 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdb08e-f9a3-447d-8e72-9eadb2bd9cfd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:43.204787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdb08e-f9a3-447d-8e72-9eadb2bd9cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:43.205162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdb08e-f9a3-447d-8e72-9eadb2bd9cfd None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:43.206113 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdb08e-f9a3-447d-8e72-9eadb2bd9cfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:43.206472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdb08e-f9a3-447d-8e72-9eadb2bd9cfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:43.208234 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdb08e-f9a3-447d-8e72-9eadb2bd9cfd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:43.221484 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 352/711] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:43.222505 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdb08e-f9a3-447d-8e72-9eadb2bd9cfd None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:43.233633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c9956-2d34-4976-8783-affffd7c77f1 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:43.270861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220624ed-25c8-42b2-8a3e-fda984a58a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:43.271823 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220624ed-25c8-42b2-8a3e-fda984a58a4c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:43.272246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220624ed-25c8-42b2-8a3e-fda984a58a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:43.272755 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220624ed-25c8-42b2-8a3e-fda984a58a4c None admin] PATH_INFO: `/v3/services/network` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:43.273631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220624ed-25c8-42b2-8a3e-fda984a58a4c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:43.275796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220624ed-25c8-42b2-8a3e-fda984a58a4c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:43.287311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-220624ed-25c8-42b2-8a3e-fda984a58a4c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:12:43.287311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:43.287311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:12:43.287311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:12:43.287311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:12:43.287311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:12:43.287311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:12:43.287311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:12:43.287311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:12:43.287311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:43.287311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:12:43.287311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:43.287311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:43.287311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:43.287311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:43.287311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:43.287311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:43.288321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:43.288321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:43.288321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:43.288321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:43.288321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:43.288321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:43.288321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:12:43.288321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:12:43.288321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:12:43.288321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:12:43.288321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:43.288321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:43.288321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:43.288321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:43.288321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:43.288321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:43.289153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:43.289153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:43.289153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:43.289153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:43.289153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:43.289153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:43.289153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:43.289153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:43.289153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:43.289153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:43.289153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:12:43.289153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:12:43.289153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:12:43.289153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:43.297262 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 360/712] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:43 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:43.298378 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220624ed-25c8-42b2-8a3e-fda984a58a4c None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:43.332045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdb08e-f9a3-447d-8e72-9eadb2bd9cfd None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:43.355381 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:43.368066 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee5d33-220a-4b71-b7bf-b45faaf5c4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:43.368774 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee5d33-220a-4b71-b7bf-b45faaf5c4b4 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:43.369129 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee5d33-220a-4b71-b7bf-b45faaf5c4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:43.369477 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee5d33-220a-4b71-b7bf-b45faaf5c4b4 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:43.370222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee5d33-220a-4b71-b7bf-b45faaf5c4b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:43.371722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee5d33-220a-4b71-b7bf-b45faaf5c4b4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:43.391545 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:43.406440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 353/713] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 16:12:43 2022] POST /identity/v3/users => generated 254 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:12:43.407265 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee5d33-220a-4b71-b7bf-b45faaf5c4b4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:43.410181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220624ed-25c8-42b2-8a3e-fda984a58a4c None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:43.451580 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce509c9-a3c7-42f0-b271-de592bff1787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:43.452444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce509c9-a3c7-42f0-b271-de592bff1787 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:43.452634 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce509c9-a3c7-42f0-b271-de592bff1787 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:43.453031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce509c9-a3c7-42f0-b271-de592bff1787 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:43.453919 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce509c9-a3c7-42f0-b271-de592bff1787 None admin] RBAC: Adding query filter params (role.id=bbf63b75406649a3b653308ecb75062d, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=e7fb290911bc4de887d04b71731f76b5) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:43.454475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce509c9-a3c7-42f0-b271-de592bff1787 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:43.455977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce509c9-a3c7-42f0-b271-de592bff1787 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:43.470261 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 361/714] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:12:43 2022] GET /identity/v3/role_assignments?user.id=e7fb290911bc4de887d04b71731f76b5&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=bbf63b75406649a3b653308ecb75062d => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:43.471273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce509c9-a3c7-42f0-b271-de592bff1787 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:43.545772 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee5d33-220a-4b71-b7bf-b45faaf5c4b4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:43.598975 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df9bf9-03d4-4334-a97e-965b2593fa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:43.600013 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df9bf9-03d4-4334-a97e-965b2593fa3b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:43.600493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df9bf9-03d4-4334-a97e-965b2593fa3b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:43.600953 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df9bf9-03d4-4334-a97e-965b2593fa3b None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:43.601795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df9bf9-03d4-4334-a97e-965b2593fa3b None admin] RBAC: Adding query filter params (name=network) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:43.602970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df9bf9-03d4-4334-a97e-965b2593fa3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:43.605878 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df9bf9-03d4-4334-a97e-965b2593fa3b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:43.611922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 354/715] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 16:12:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:43.620989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df9bf9-03d4-4334-a97e-965b2593fa3b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:43.657335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce509c9-a3c7-42f0-b271-de592bff1787 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:43.679759 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:43.704408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:43.711658 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e01b4c-a787-4f6d-ac79-40ca145e0504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:43.711658 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e01b4c-a787-4f6d-ac79-40ca145e0504 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:43.712010 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e01b4c-a787-4f6d-ac79-40ca145e0504 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:43.712255 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e01b4c-a787-4f6d-ac79-40ca145e0504 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:43.712905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e01b4c-a787-4f6d-ac79-40ca145e0504 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:43.714337 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e01b4c-a787-4f6d-ac79-40ca145e0504 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:43.723714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-b9e01b4c-a787-4f6d-ac79-40ca145e0504 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:12:43.723714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:43.723714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:12:43.723714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:12:43.723714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:12:43.723714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:12:43.723714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:12:43.723714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:12:43.723714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:12:43.723714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:43.723714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:12:43.723714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:43.723714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:43.723714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:43.723714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:43.723714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:43.723714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:43.724754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:43.724754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:43.724754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:43.724754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:43.724754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:43.724754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:43.724754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:12:43.724754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:12:43.724754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:12:43.724754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:12:43.724754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:43.724754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:43.724754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:43.724754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:43.724754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:43.724754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:43.725606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:43.725606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:43.725606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:43.725606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:43.725606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:43.725606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:43.725606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:43.725606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:43.725606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:43.725606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:43.725606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:12:43.725606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:12:43.725606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:12:43.725606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:43.730227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 362/716] 10.222.0.16 () {56 vars in 1129 bytes} [Tue Aug 23 16:12:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:43.732120 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e01b4c-a787-4f6d-ac79-40ca145e0504 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:43.757474 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df9bf9-03d4-4334-a97e-965b2593fa3b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:43.794269 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e146246-5b31-4060-9e83-0b04face6af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:43.794900 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e146246-5b31-4060-9e83-0b04face6af0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:43.795185 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e146246-5b31-4060-9e83-0b04face6af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:43.795465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e146246-5b31-4060-9e83-0b04face6af0 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:43.796126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e146246-5b31-4060-9e83-0b04face6af0 None admin] RBAC: Adding query filter params (type=network) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:43.796419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e146246-5b31-4060-9e83-0b04face6af0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:43.797796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e146246-5b31-4060-9e83-0b04face6af0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:43.804387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 355/717] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 16:12:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:43.847474 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e01b4c-a787-4f6d-ac79-40ca145e0504 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:43.888070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a677257-2ac0-477a-b259-2439f2cf9017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:43.888729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a677257-2ac0-477a-b259-2439f2cf9017 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:43.888975 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a677257-2ac0-477a-b259-2439f2cf9017 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:43.889250 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a677257-2ac0-477a-b259-2439f2cf9017 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:43.889902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a677257-2ac0-477a-b259-2439f2cf9017 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:43.890246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a677257-2ac0-477a-b259-2439f2cf9017 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:43.891671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a677257-2ac0-477a-b259-2439f2cf9017 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:43.902124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 363/718] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 23 16:12:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:43.903667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e146246-5b31-4060-9e83-0b04face6af0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:44.017883 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e146246-5b31-4060-9e83-0b04face6af0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:44.055076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:44.069670 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26e5db-e28b-4a5f-a834-ecfd23d0653e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:44.070550 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26e5db-e28b-4a5f-a834-ecfd23d0653e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:44.070977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26e5db-e28b-4a5f-a834-ecfd23d0653e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:44.071993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26e5db-e28b-4a5f-a834-ecfd23d0653e None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:44.072960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26e5db-e28b-4a5f-a834-ecfd23d0653e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:44.073411 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26e5db-e28b-4a5f-a834-ecfd23d0653e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:44.074959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26e5db-e28b-4a5f-a834-ecfd23d0653e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:44.086294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 356/719] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 23 16:12:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:45.085282 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88250bfd-0b6f-4cad-9894-914e5db0a7bd None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:45.085954 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88250bfd-0b6f-4cad-9894-914e5db0a7bd None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:45.085954 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88250bfd-0b6f-4cad-9894-914e5db0a7bd None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:45.089206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 364/720] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:45.098116 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b30cea-7c92-4152-ab8d-2432ff1bf85a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:45.098116 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b30cea-7c92-4152-ab8d-2432ff1bf85a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:45.098116 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b30cea-7c92-4152-ab8d-2432ff1bf85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:45.128207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-16b30cea-7c92-4152-ab8d-2432ff1bf85a None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:45.129816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-16b30cea-7c92-4152-ab8d-2432ff1bf85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:45.248358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 357/721] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:45.705243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88250bfd-0b6f-4cad-9894-914e5db0a7bd None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:45.768281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:45.847821 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88250bfd-0b6f-4cad-9894-914e5db0a7bd None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:45.895713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad8df5-bcfe-4667-b038-25d475143b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:45.896525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad8df5-bcfe-4667-b038-25d475143b9c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:45.896813 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad8df5-bcfe-4667-b038-25d475143b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:45.897089 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad8df5-bcfe-4667-b038-25d475143b9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:45.909632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad8df5-bcfe-4667-b038-25d475143b9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:45.914323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-27ad8df5-bcfe-4667-b038-25d475143b9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:12:45.914323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:45.914323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:45.914323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:45.914323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:45.914323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:45.914323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:45.914323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:45.914323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:45.914323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:45.914323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:45.914323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:45.914323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:45.914323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:45.914323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:45.914323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:45.915283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:45.915283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:45.915283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:45.915283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:45.915283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:45.915283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:45.915283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:45.915283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:45.915283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:45.915283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:45.915283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:45.915283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:45.915283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:45.915283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:45.915283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:45.915283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:45.916268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:45.916268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:45.916268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:45.916268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:45.916268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:45.916268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:45.916268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:45.916268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:45.916268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:45.916268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:45.916268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:12:45.916268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:45.919163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 365/722] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:12:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:45.925063 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b30cea-7c92-4152-ab8d-2432ff1bf85a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:45.987550 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54e9a5-e0f8-4520-868c-6e47b39ea55d None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:45.987839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54e9a5-e0f8-4520-868c-6e47b39ea55d None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:45.988046 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54e9a5-e0f8-4520-868c-6e47b39ea55d None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:45.989907 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 366/723] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:45.996619 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236759d-b115-43b5-85b0-1e3ac61d0358 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:45.996911 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236759d-b115-43b5-85b0-1e3ac61d0358 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:45.997300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236759d-b115-43b5-85b0-1e3ac61d0358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:46.038275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-9236759d-b115-43b5-85b0-1e3ac61d0358 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:46.039494 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9236759d-b115-43b5-85b0-1e3ac61d0358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:46.052796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b30cea-7c92-4152-ab8d-2432ff1bf85a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:46.091255 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:46.115986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b20283-7689-4338-83c2-b68d216395e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:46.116619 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b20283-7689-4338-83c2-b68d216395e8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:46.116874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b20283-7689-4338-83c2-b68d216395e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:46.117157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b20283-7689-4338-83c2-b68d216395e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:46.117877 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b20283-7689-4338-83c2-b68d216395e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:46.118259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b20283-7689-4338-83c2-b68d216395e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:46.119641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b20283-7689-4338-83c2-b68d216395e8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:46.134961 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 358/724] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:46.141836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b20283-7689-4338-83c2-b68d216395e8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:46.169844 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 367/725] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:12:46.268057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b20283-7689-4338-83c2-b68d216395e8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:46.317540 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12cf48-5833-461e-8d57-1b63e5609241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:46.318203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12cf48-5833-461e-8d57-1b63e5609241 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:46.318483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12cf48-5833-461e-8d57-1b63e5609241 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:46.318756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e12cf48-5833-461e-8d57-1b63e5609241 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:46.330368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12cf48-5833-461e-8d57-1b63e5609241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:46.331793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e12cf48-5833-461e-8d57-1b63e5609241 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:46.351655 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30954776-71cd-4e44-8fb6-6181a46a3923 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:46.352225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-7e12cf48-5833-461e-8d57-1b63e5609241 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:46.352225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:46.352225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:46.352225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:46.352225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:46.352225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:46.352225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:46.352225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:46.352225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:46.352225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:46.352225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:46.352225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:46.352225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:46.352225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:46.352225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:46.352225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:46.353614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:46.353614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:46.353614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:46.353614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:46.353614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:46.353614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:46.353614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:46.353614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:46.353614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:46.353614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:46.353614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:46.353614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:46.353614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:46.353614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:46.353614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:46.353614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:46.353614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:46.354948 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:46.354948 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:46.354948 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:46.354948 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 359/726] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:46.355421 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30954776-71cd-4e44-8fb6-6181a46a3923 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:46.355922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30954776-71cd-4e44-8fb6-6181a46a3923 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:46.357454 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 368/727] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:12:46.363148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12cf48-5833-461e-8d57-1b63e5609241 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:46.367725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a8b95-5c74-4c95-892b-89c42036be81 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:46.368977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a8b95-5c74-4c95-892b-89c42036be81 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:46.369704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a8b95-5c74-4c95-892b-89c42036be81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:46.388906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e14a8b95-5c74-4c95-892b-89c42036be81 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:46.390528 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e14a8b95-5c74-4c95-892b-89c42036be81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:46.418444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:46.439333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:46.482780 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 369/728] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 16:12:46.484124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3cc6b-68e8-48c8-9983-65d3d8c7d665 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:46.484413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3cc6b-68e8-48c8-9983-65d3d8c7d665 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:46.484690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3cc6b-68e8-48c8-9983-65d3d8c7d665 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:46.490205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 370/729] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:46.491415 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d9153-430a-41ba-9169-22738bf6b384 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:46.491702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d9153-430a-41ba-9169-22738bf6b384 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:46.491978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d9153-430a-41ba-9169-22738bf6b384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:46.514214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e12cf48-5833-461e-8d57-1b63e5609241 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:46.516262 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-bc9d9153-430a-41ba-9169-22738bf6b384 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:46.517729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-bc9d9153-430a-41ba-9169-22738bf6b384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:46.553098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44d67b-6234-498d-8a14-5505191f0e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:46.553721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44d67b-6234-498d-8a14-5505191f0e05 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:46.554090 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44d67b-6234-498d-8a14-5505191f0e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:46.554531 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44d67b-6234-498d-8a14-5505191f0e05 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:46.555243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44d67b-6234-498d-8a14-5505191f0e05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:46.556299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44d67b-6234-498d-8a14-5505191f0e05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:46.557901 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44d67b-6234-498d-8a14-5505191f0e05 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:46.570705 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 360/730] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:46.571812 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44d67b-6234-498d-8a14-5505191f0e05 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:46.613387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 371/731] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:46.614572 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d9153-430a-41ba-9169-22738bf6b384 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:46.729197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:46.737770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d9153-430a-41ba-9169-22738bf6b384 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:46.755467 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:46.766390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44d67b-6234-498d-8a14-5505191f0e05 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:46.792328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4470dc-49db-4d61-bf50-4c06096050f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:46.793025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4470dc-49db-4d61-bf50-4c06096050f0 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:46.793307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4470dc-49db-4d61-bf50-4c06096050f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:46.793580 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4470dc-49db-4d61-bf50-4c06096050f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:46.802100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4470dc-49db-4d61-bf50-4c06096050f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:46.802794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4470dc-49db-4d61-bf50-4c06096050f0 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:46.815235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-fb4470dc-49db-4d61-bf50-4c06096050f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:12:46.815235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:46.815235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:46.815235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:46.815235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:46.815235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:46.815235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:46.815235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:46.815235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:46.815235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:46.815235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:46.815235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:46.815235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:46.815235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:46.815235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:46.815235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:46.816201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:46.816201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:46.816201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:46.816201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:46.816201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:46.816201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:46.816201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:46.816201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:46.816201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:46.816201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:46.816201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:46.816201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:46.816201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:46.816201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:46.816201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:46.816201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:46.816201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:46.816201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:46.817564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:46.817564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:46.817564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:46.817564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:46.817564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:46.817564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:46.817564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:46.817564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:46.817564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:12:46.817564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:46.817564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 372/732] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 23 16:12:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:46.817564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4470dc-49db-4d61-bf50-4c06096050f0 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:46.823110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cc57b-bcb0-416b-b479-747261aaf088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:46.824023 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cc57b-bcb0-416b-b479-747261aaf088 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:46.824507 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cc57b-bcb0-416b-b479-747261aaf088 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:46.825096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cc57b-bcb0-416b-b479-747261aaf088 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:46.836411 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260cc57b-bcb0-416b-b479-747261aaf088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:46.842551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-260cc57b-bcb0-416b-b479-747261aaf088 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:46.842551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:46.842551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:46.842551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:46.842551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:46.842551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:46.842551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:46.842551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:46.842551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:46.842551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:46.842551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:46.842551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:46.842551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:46.842551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:46.842551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:46.842551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:46.843482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:46.843482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:46.843482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:46.843482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:46.843482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:46.843482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:46.843482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:46.843482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:46.843482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:46.843482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:46.843482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:46.843482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:46.843482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:46.843482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:46.843482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:46.843482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:46.844310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:46.844310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:46.844310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:46.844310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:46.844310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:46.844310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:46.844310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:46.844310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:46.844310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:46.844310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:46.844310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:46.844310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:46.847031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 361/733] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:46.848083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cc57b-bcb0-416b-b479-747261aaf088 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:46.932789 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4470dc-49db-4d61-bf50-4c06096050f0 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:46.957535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cc57b-bcb0-416b-b479-747261aaf088 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:46.968004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6ef2d-df4b-4b17-8518-9981862773cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:46.968630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6ef2d-df4b-4b17-8518-9981862773cc None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:46.968902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6ef2d-df4b-4b17-8518-9981862773cc None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:46.969160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6ef2d-df4b-4b17-8518-9981862773cc None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:46.969806 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6ef2d-df4b-4b17-8518-9981862773cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:46.971205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad6ef2d-df4b-4b17-8518-9981862773cc None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:46.988527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 373/734] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 16:12:46 2022] POST /identity/v3/services => generated 240 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:12:46.989369 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6ef2d-df4b-4b17-8518-9981862773cc None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:47.016217 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290f63e-f319-4c0c-a2dc-ce89d504033f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:47.017264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290f63e-f319-4c0c-a2dc-ce89d504033f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:47.017779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290f63e-f319-4c0c-a2dc-ce89d504033f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:47.018308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290f63e-f319-4c0c-a2dc-ce89d504033f None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:47.019344 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290f63e-f319-4c0c-a2dc-ce89d504033f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:47.019879 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290f63e-f319-4c0c-a2dc-ce89d504033f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:47.021573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290f63e-f319-4c0c-a2dc-ce89d504033f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:47.022485 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:47.056358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 362/735] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 23 16:12:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:47.058823 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290f63e-f319-4c0c-a2dc-ce89d504033f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:47.080483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:47.152916 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6ef2d-df4b-4b17-8518-9981862773cc None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:47.200884 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ed331-c66e-4f6a-b664-199c495a9010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:47.201518 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ed331-c66e-4f6a-b664-199c495a9010 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:47.201777 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ed331-c66e-4f6a-b664-199c495a9010 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:47.202048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ed331-c66e-4f6a-b664-199c495a9010 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:47.202814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ed331-c66e-4f6a-b664-199c495a9010 None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:47.203052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ed331-c66e-4f6a-b664-199c495a9010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:47.204437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86ed331-c66e-4f6a-b664-199c495a9010 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:47.210181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290f63e-f319-4c0c-a2dc-ce89d504033f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:47.216219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 374/736] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:47.216219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ed331-c66e-4f6a-b664-199c495a9010 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:47.249362 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651e92c-d4e2-47a5-a16a-2dd8aafe7aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:47.249996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651e92c-d4e2-47a5-a16a-2dd8aafe7aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:47.250310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651e92c-d4e2-47a5-a16a-2dd8aafe7aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:47.250580 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651e92c-d4e2-47a5-a16a-2dd8aafe7aa4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:47.261379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651e92c-d4e2-47a5-a16a-2dd8aafe7aa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:47.266052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-1651e92c-d4e2-47a5-a16a-2dd8aafe7aa4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:12:47.266052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:47.266052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:47.266052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:47.266052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:47.266052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:47.266052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:47.266052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:47.266052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:47.266052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:47.266052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:47.266052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:47.266052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:47.266052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:47.266052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:47.266052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:47.267022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:47.267022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:47.267022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:47.267022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:47.267022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:47.267022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:47.267022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:47.267022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:47.267022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:47.267022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:47.267022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:47.267022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:47.267022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:47.267022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:47.267022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:47.267022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:47.267959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:47.267959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:47.267959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:47.267959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:47.267959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:47.267959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:47.267959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:47.267959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:47.267959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:47.267959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:47.267959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:12:47.267959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:47.267959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 363/737] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:12:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:47.268637 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22184654-6d65-4f78-8138-04ecfacffd2c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:47.269166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22184654-6d65-4f78-8138-04ecfacffd2c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:47.269270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22184654-6d65-4f78-8138-04ecfacffd2c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:47.276241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 364/738] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:47.276241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22184654-6d65-4f78-8138-04ecfacffd2c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:47.311012 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:47.339988 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ed331-c66e-4f6a-b664-199c495a9010 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:47.348554 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:47.377324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068d549-d4d7-4078-873a-dbb8d87c2cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:47.377951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068d549-d4d7-4078-873a-dbb8d87c2cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:47.378271 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068d549-d4d7-4078-873a-dbb8d87c2cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:47.378537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068d549-d4d7-4078-873a-dbb8d87c2cd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:47.383309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22184654-6d65-4f78-8138-04ecfacffd2c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:47.390962 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068d549-d4d7-4078-873a-dbb8d87c2cd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:47.392399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068d549-d4d7-4078-873a-dbb8d87c2cd0 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:47.407977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-c068d549-d4d7-4078-873a-dbb8d87c2cd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:47.407977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:47.407977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:47.407977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:47.407977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:47.407977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:47.407977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:47.407977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:47.407977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:47.407977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:47.407977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:47.407977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:47.407977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:47.407977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:47.407977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:47.407977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:47.409235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:47.409235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:47.409235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:47.409235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:47.409235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:47.409235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:47.409235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:47.409235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:47.409235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:47.409235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:47.409235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:47.409235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:47.409235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:47.409235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:47.409235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:47.409235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:47.409235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:47.410127 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:47.410127 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:47.410127 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:47.410127 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 375/739] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:47.410368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068d549-d4d7-4078-873a-dbb8d87c2cd0 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:47.429996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76272895-d9c7-41e4-afa5-89beca4e8f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:47.430841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76272895-d9c7-41e4-afa5-89beca4e8f29 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:47.431186 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76272895-d9c7-41e4-afa5-89beca4e8f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:47.431522 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76272895-d9c7-41e4-afa5-89beca4e8f29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:47.442780 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76272895-d9c7-41e4-afa5-89beca4e8f29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:47.444226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76272895-d9c7-41e4-afa5-89beca4e8f29 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:47.460077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-76272895-d9c7-41e4-afa5-89beca4e8f29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:47.460077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:47.460077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:47.460077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:47.460077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:47.460077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:47.460077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:47.460077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:47.460077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:47.460077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:47.460077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:47.460077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:47.460077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:47.460077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:47.460077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:47.460077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:47.461247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:47.461247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:47.461247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:47.461247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:47.461247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:47.461247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:47.461247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:47.461247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:47.461247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:47.461247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:47.461247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:47.461247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:47.461247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:47.461247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:47.461247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:47.461247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:47.461247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:47.462885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:47.462885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:47.462885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:47.462885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 365/740] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:47.463394 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528bb2f-8daf-40b4-8980-df895fdd7431 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:47.463672 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528bb2f-8daf-40b4-8980-df895fdd7431 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:47.463941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528bb2f-8daf-40b4-8980-df895fdd7431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:47.481753 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b528bb2f-8daf-40b4-8980-df895fdd7431 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:47.482973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b528bb2f-8daf-40b4-8980-df895fdd7431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:47.530366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068d549-d4d7-4078-873a-dbb8d87c2cd0 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:47.556941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 366/741] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:47 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 16:12:47.558009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528bb2f-8daf-40b4-8980-df895fdd7431 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:47.563474 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:47.574793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1ae61-7bca-4932-8647-413fbc5eebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:47.575784 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1ae61-7bca-4932-8647-413fbc5eebf6 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:47.576289 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1ae61-7bca-4932-8647-413fbc5eebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:47.576731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1ae61-7bca-4932-8647-413fbc5eebf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:47.577578 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1ae61-7bca-4932-8647-413fbc5eebf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:47.578227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1ae61-7bca-4932-8647-413fbc5eebf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:47.579880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1ae61-7bca-4932-8647-413fbc5eebf6 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:47.590944 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 376/742] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:47.592225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1ae61-7bca-4932-8647-413fbc5eebf6 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:47.613473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:47.661119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528bb2f-8daf-40b4-8980-df895fdd7431 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:47.696438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de527e8-fdfd-4126-b9c7-ea4c7a3ae6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:47.697047 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de527e8-fdfd-4126-b9c7-ea4c7a3ae6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:47.697324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de527e8-fdfd-4126-b9c7-ea4c7a3ae6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:47.697595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de527e8-fdfd-4126-b9c7-ea4c7a3ae6e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:47.698268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de527e8-fdfd-4126-b9c7-ea4c7a3ae6e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:47.698570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de527e8-fdfd-4126-b9c7-ea4c7a3ae6e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:47.699935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de527e8-fdfd-4126-b9c7-ea4c7a3ae6e8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:47.712476 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 367/743] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:47.713461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de527e8-fdfd-4126-b9c7-ea4c7a3ae6e8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:47.717907 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1ae61-7bca-4932-8647-413fbc5eebf6 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:47.756586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1626ab-0121-46c3-910d-18c36ae8b7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:47.757782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1626ab-0121-46c3-910d-18c36ae8b7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:47.758285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1626ab-0121-46c3-910d-18c36ae8b7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:47.759130 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1626ab-0121-46c3-910d-18c36ae8b7c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:47.759974 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1626ab-0121-46c3-910d-18c36ae8b7c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:47.760449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1626ab-0121-46c3-910d-18c36ae8b7c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:47.762342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1626ab-0121-46c3-910d-18c36ae8b7c4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:47.782011 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 377/744] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:47.783160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1626ab-0121-46c3-910d-18c36ae8b7c4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:47.818868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de527e8-fdfd-4126-b9c7-ea4c7a3ae6e8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:47.831766 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:47.843671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:47.855326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01997e87-b7a1-4e82-9e44-e0b53e18174f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:47.855983 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01997e87-b7a1-4e82-9e44-e0b53e18174f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:47.856265 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01997e87-b7a1-4e82-9e44-e0b53e18174f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:47.856537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01997e87-b7a1-4e82-9e44-e0b53e18174f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:47.867262 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01997e87-b7a1-4e82-9e44-e0b53e18174f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:47.868723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01997e87-b7a1-4e82-9e44-e0b53e18174f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:47.882270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-01997e87-b7a1-4e82-9e44-e0b53e18174f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:47.882270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:47.882270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:47.882270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:47.882270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:47.882270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:47.882270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:47.882270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:47.882270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:47.882270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:47.882270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:47.882270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:47.882270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:47.882270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:47.882270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:47.882270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:47.883541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:47.883541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:47.883541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:47.883541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:47.883541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:47.883541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:47.883541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:47.883541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:47.883541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:47.883541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:47.883541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:47.883541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:47.883541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:47.883541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:47.883541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:47.883541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:47.883541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:47.884903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:47.884903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:47.884903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:47.884903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 368/745] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:47.884903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01997e87-b7a1-4e82-9e44-e0b53e18174f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:47.905501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1626ab-0121-46c3-910d-18c36ae8b7c4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:47.943905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70eb810-e3ab-4b03-a604-02e8ab26b972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:47.944537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eb810-e3ab-4b03-a604-02e8ab26b972 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:47.944819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eb810-e3ab-4b03-a604-02e8ab26b972 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:47.945095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eb810-e3ab-4b03-a604-02e8ab26b972 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:47.953235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70eb810-e3ab-4b03-a604-02e8ab26b972 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:47.955158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70eb810-e3ab-4b03-a604-02e8ab26b972 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:47.969640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-a70eb810-e3ab-4b03-a604-02e8ab26b972 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:47.969640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:47.969640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:47.969640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:47.969640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:47.969640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:47.969640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:47.969640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:47.969640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:47.969640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:47.969640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:47.969640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:47.969640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:47.969640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:47.969640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:47.970726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:47.970726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:47.970726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:47.970726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:47.970726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:47.970726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:47.970726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:47.970726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:47.970726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:47.970726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:47.970726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:47.970726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:47.970726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:47.970726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:47.970726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:47.970726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:47.970726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:47.971699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:47.971699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:47.971699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:47.971699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:47.971699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:47.971699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:47.971699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:47.971699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:47.971699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 378/746] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:47.972172 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70eb810-e3ab-4b03-a604-02e8ab26b972 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:48.000849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01997e87-b7a1-4e82-9e44-e0b53e18174f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:48.037742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9989db6-ca8d-494d-bb15-e421b9a5ce38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:48.038425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9989db6-ca8d-494d-bb15-e421b9a5ce38 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:48.038710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9989db6-ca8d-494d-bb15-e421b9a5ce38 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:48.038986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9989db6-ca8d-494d-bb15-e421b9a5ce38 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:48.048742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9989db6-ca8d-494d-bb15-e421b9a5ce38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:48.050264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9989db6-ca8d-494d-bb15-e421b9a5ce38 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:48.063366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b9989db6-ca8d-494d-bb15-e421b9a5ce38 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:12:48.063366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:48.063366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:48.063366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:48.063366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:48.063366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:48.063366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:48.063366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:48.063366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:48.063366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:48.063366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:48.063366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:48.063366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:48.063366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:48.063366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:48.063366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:48.064481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:48.064481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:48.064481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:48.064481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:48.064481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:48.064481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:48.064481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:48.064481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:48.064481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:48.064481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:48.064481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:48.064481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:48.064481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:48.064481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:48.064481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:48.064481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:48.064481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:48.064481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:48.065430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:48.065430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:48.065430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:48.065430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:48.065430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:48.065430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:48.065430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:48.065430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:48.065430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:12:48.065430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:48.065430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 369/747] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 23 16:12:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:48.066024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9989db6-ca8d-494d-bb15-e421b9a5ce38 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:48.105210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70eb810-e3ab-4b03-a604-02e8ab26b972 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:48.106209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:48.119048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:48.144797 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540fd2f-a1c4-4379-9c22-39f4802d0d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:48.145410 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540fd2f-a1c4-4379-9c22-39f4802d0d23 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:48.145690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540fd2f-a1c4-4379-9c22-39f4802d0d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:48.145961 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540fd2f-a1c4-4379-9c22-39f4802d0d23 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:48.146634 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540fd2f-a1c4-4379-9c22-39f4802d0d23 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:48.147984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540fd2f-a1c4-4379-9c22-39f4802d0d23 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:48.174595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 379/748] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 16:12:47 2022] POST /identity/v3/services => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:12:48.174595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540fd2f-a1c4-4379-9c22-39f4802d0d23 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:48.212100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9989db6-ca8d-494d-bb15-e421b9a5ce38 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:48.261212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df3719-26d8-4677-888d-473306821021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:48.262173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df3719-26d8-4677-888d-473306821021 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:48.262593 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df3719-26d8-4677-888d-473306821021 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:48.263000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df3719-26d8-4677-888d-473306821021 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:48.263916 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df3719-26d8-4677-888d-473306821021 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:48.264383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df3719-26d8-4677-888d-473306821021 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:48.265978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df3719-26d8-4677-888d-473306821021 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:48.284817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540fd2f-a1c4-4379-9c22-39f4802d0d23 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:48.285737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 370/749] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:48.286997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df3719-26d8-4677-888d-473306821021 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:48.323667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5ca27-4cfd-4e04-9796-47fd2f3e2e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:48.324278 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5ca27-4cfd-4e04-9796-47fd2f3e2e01 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:48.324796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5ca27-4cfd-4e04-9796-47fd2f3e2e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:48.324796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5ca27-4cfd-4e04-9796-47fd2f3e2e01 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:48.325513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5ca27-4cfd-4e04-9796-47fd2f3e2e01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:48.325819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5ca27-4cfd-4e04-9796-47fd2f3e2e01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:48.327298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5ca27-4cfd-4e04-9796-47fd2f3e2e01 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:48.340970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 380/750] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:48.345885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5ca27-4cfd-4e04-9796-47fd2f3e2e01 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:48.377351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:48.391259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:48.431357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df3719-26d8-4677-888d-473306821021 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:48.466391 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5ca27-4cfd-4e04-9796-47fd2f3e2e01 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:48.479458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8e769-9473-42a9-8601-9ab8c5cda103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:48.480519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8e769-9473-42a9-8601-9ab8c5cda103 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:48.480901 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8e769-9473-42a9-8601-9ab8c5cda103 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:48.481279 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8e769-9473-42a9-8601-9ab8c5cda103 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:48.482415 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8e769-9473-42a9-8601-9ab8c5cda103 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:48.482831 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8e769-9473-42a9-8601-9ab8c5cda103 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:48.485207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8e769-9473-42a9-8601-9ab8c5cda103 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:48.505051 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2836d0-23e9-4723-9324-b47744670114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:48.505897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2836d0-23e9-4723-9324-b47744670114 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:48.506372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2836d0-23e9-4723-9324-b47744670114 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:48.506784 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2836d0-23e9-4723-9324-b47744670114 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:48.509719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 371/751] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 23 16:12:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:48.514730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8e769-9473-42a9-8601-9ab8c5cda103 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:48.519868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2836d0-23e9-4723-9324-b47744670114 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:48.521468 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2836d0-23e9-4723-9324-b47744670114 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:48.536111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-cd2836d0-23e9-4723-9324-b47744670114 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:12:48.536111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:48.536111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:48.536111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:48.536111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:48.536111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:48.536111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:48.536111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:48.536111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:48.536111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:48.536111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:48.536111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:48.536111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:48.536111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:48.536111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:48.536111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:48.537298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:48.537298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:48.537298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:48.537298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:48.537298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:48.537298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:48.537298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:48.537298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:48.537298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:48.537298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:48.537298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:48.537298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:48.537298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:48.537298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:48.537298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:48.537298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:48.537298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:48.537298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:48.538475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:48.538475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:48.538475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:48.538475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:48.538475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:48.538475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:48.538475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:48.538475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:48.538475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:12:48.538475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:48.541128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 381/752] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:12:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:48.542090 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2836d0-23e9-4723-9324-b47744670114 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:48.640383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:48.644123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8e769-9473-42a9-8601-9ab8c5cda103 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:48.651509 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2836d0-23e9-4723-9324-b47744670114 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:48.683786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33462ee7-3104-45e5-812e-4a4bf143bc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:48.684653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33462ee7-3104-45e5-812e-4a4bf143bc48 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:48.685001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33462ee7-3104-45e5-812e-4a4bf143bc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:48.685380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33462ee7-3104-45e5-812e-4a4bf143bc48 None admin] PATH_INFO: `/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/767ca33ca8e244f8a0cc773e3b6abefb/roles/8de0c87242d7426ea25a510b578c02aa` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:48.687924 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33462ee7-3104-45e5-812e-4a4bf143bc48 None admin] RBAC: Authorizing `identity:create_grant(project_id=15a0439c9dd3406f81e2740fe775782b, user_id=767ca33ca8e244f8a0cc773e3b6abefb, role_id=8de0c87242d7426ea25a510b578c02aa)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:48.689073 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5f7bb-083d-4a1c-a843-1827aa890321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:48.689660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33462ee7-3104-45e5-812e-4a4bf143bc48 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:48.689994 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5f7bb-083d-4a1c-a843-1827aa890321 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:48.690482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5f7bb-083d-4a1c-a843-1827aa890321 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:48.690965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5f7bb-083d-4a1c-a843-1827aa890321 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:48.702859 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:48.708765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 372/753] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:12:48 2022] PUT /identity/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/767ca33ca8e244f8a0cc773e3b6abefb/roles/8de0c87242d7426ea25a510b578c02aa => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:12:48.709849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33462ee7-3104-45e5-812e-4a4bf143bc48 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:48.830045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5f7bb-083d-4a1c-a843-1827aa890321 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:48.831586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5f7bb-083d-4a1c-a843-1827aa890321 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:48.849366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33462ee7-3104-45e5-812e-4a4bf143bc48 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:48.920581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf98b52-488b-44aa-86db-ee14d6fe59c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:48.921122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf98b52-488b-44aa-86db-ee14d6fe59c8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:48.921404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf98b52-488b-44aa-86db-ee14d6fe59c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:48.921678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf98b52-488b-44aa-86db-ee14d6fe59c8 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:48.922467 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf98b52-488b-44aa-86db-ee14d6fe59c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:48.922776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf98b52-488b-44aa-86db-ee14d6fe59c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:48.924201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf98b52-488b-44aa-86db-ee14d6fe59c8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:48.946386 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 373/754] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 23 16:12:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:48.957427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf98b52-488b-44aa-86db-ee14d6fe59c8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:49.014441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:49.030453 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 382/755] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:12:49.036086 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5f7bb-083d-4a1c-a843-1827aa890321 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:49.066426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:49.128635 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf98b52-488b-44aa-86db-ee14d6fe59c8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:49.156952 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5f7bb-083d-4a1c-a843-1827aa890321 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:49.173189 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d36d0-4972-4a04-9e2b-e0599b6421bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:49.174199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d36d0-4972-4a04-9e2b-e0599b6421bd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:49.174491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d36d0-4972-4a04-9e2b-e0599b6421bd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:49.174768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d36d0-4972-4a04-9e2b-e0599b6421bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:49.207387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add548a-cc93-4511-b327-34d9c7a9bb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:49.208387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add548a-cc93-4511-b327-34d9c7a9bb73 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:49.208872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add548a-cc93-4511-b327-34d9c7a9bb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:49.209368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add548a-cc93-4511-b327-34d9c7a9bb73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:49.221709 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add548a-cc93-4511-b327-34d9c7a9bb73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:49.223468 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add548a-cc93-4511-b327-34d9c7a9bb73 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:49.239927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-2add548a-cc93-4511-b327-34d9c7a9bb73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:49.239927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:49.239927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:49.239927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:49.239927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:49.239927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:49.239927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:49.239927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:49.239927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:49.239927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:49.239927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:49.239927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:49.239927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:49.239927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:49.239927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:49.239927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:49.241015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:49.241015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:49.241015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:49.241015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:49.241015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:49.241015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:49.241015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:49.241015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:49.241015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:49.241015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:49.241015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:49.241015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:49.241015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:49.241015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:49.241015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:49.241015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:49.241015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:49.241907 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:49.241907 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:49.241907 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:49.244829 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 383/756] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:12:49.246379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe8b11-cf29-485f-9dd9-379e786a038c None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:49.246878 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe8b11-cf29-485f-9dd9-379e786a038c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:49.247391 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe8b11-cf29-485f-9dd9-379e786a038c None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:49.249088 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 384/757] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:49.249964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe8b11-cf29-485f-9dd9-379e786a038c None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:49.263744 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d36d0-4972-4a04-9e2b-e0599b6421bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:49.265206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d36d0-4972-4a04-9e2b-e0599b6421bd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:49.306001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:49.346759 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:49.381830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe8b11-cf29-485f-9dd9-379e786a038c None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:49.416397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 374/758] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:12:49.418135 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b59f3-c079-4db7-8f71-b8f5735ad205 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:49.418653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b59f3-c079-4db7-8f71-b8f5735ad205 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:49.419126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b59f3-c079-4db7-8f71-b8f5735ad205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:49.424547 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c74cd-71c4-4db7-a9bf-0c83b32eac7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:49.425145 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c74cd-71c4-4db7-a9bf-0c83b32eac7f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:49.425474 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c74cd-71c4-4db7-a9bf-0c83b32eac7f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:49.425753 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c74cd-71c4-4db7-a9bf-0c83b32eac7f None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:49.426442 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c74cd-71c4-4db7-a9bf-0c83b32eac7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:49.426745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c74cd-71c4-4db7-a9bf-0c83b32eac7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:49.428104 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c74cd-71c4-4db7-a9bf-0c83b32eac7f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:49.442613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e52b59f3-c079-4db7-8f71-b8f5735ad205 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:49.443804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e52b59f3-c079-4db7-8f71-b8f5735ad205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:49.445632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 385/759] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:49.448167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c74cd-71c4-4db7-a9bf-0c83b32eac7f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:49.521326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 375/760] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:12:49.522399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b59f3-c079-4db7-8f71-b8f5735ad205 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:49.553321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c74cd-71c4-4db7-a9bf-0c83b32eac7f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:49.554895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:49.589414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45c4d6-8c9d-4d13-a1fa-cb7f89a65d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:49.590044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45c4d6-8c9d-4d13-a1fa-cb7f89a65d51 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:49.590354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45c4d6-8c9d-4d13-a1fa-cb7f89a65d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:49.590631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45c4d6-8c9d-4d13-a1fa-cb7f89a65d51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:49.601383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45c4d6-8c9d-4d13-a1fa-cb7f89a65d51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:49.603113 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45c4d6-8c9d-4d13-a1fa-cb7f89a65d51 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:49.617901 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:49.618163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-ad45c4d6-8c9d-4d13-a1fa-cb7f89a65d51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:49.618163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:49.618163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:49.618163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:49.618163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:49.618163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:49.618163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:49.618163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:49.618163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:49.618163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:49.618163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:49.618163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:49.618163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:49.618163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:49.618163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:49.618163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:49.619085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:49.619085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:49.619085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:49.619085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:49.619085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:49.619085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:49.619085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:49.619085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:49.619085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:49.619085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:49.619085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:49.619085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:49.619085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:49.619085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:49.619085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:49.619085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:49.619085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:49.619960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:49.619960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:49.619960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:49.619960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 386/761] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:49.624903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45c4d6-8c9d-4d13-a1fa-cb7f89a65d51 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:49.639103 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b59f3-c079-4db7-8f71-b8f5735ad205 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:49.677223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd7711-4b03-4757-ba6c-10869b682253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:49.678215 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd7711-4b03-4757-ba6c-10869b682253 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:49.678671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd7711-4b03-4757-ba6c-10869b682253 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:49.679117 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd7711-4b03-4757-ba6c-10869b682253 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:49.687273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd7711-4b03-4757-ba6c-10869b682253 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:49.689072 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd7711-4b03-4757-ba6c-10869b682253 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:49.702007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-78fd7711-4b03-4757-ba6c-10869b682253 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:49.702007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:49.702007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:49.702007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:49.702007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:49.702007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:49.702007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:49.702007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:49.702007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:49.702007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:49.702007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:49.702007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:49.702007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:49.702007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:49.702007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:49.702925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:49.702925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:49.702925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:49.702925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:49.702925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:49.702925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:49.702925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:49.702925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:49.702925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:49.702925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:49.702925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:49.702925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:49.702925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:49.702925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:49.702925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:49.702925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:49.702925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:49.703814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:49.703814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:49.703814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:49.703814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:49.703814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:49.703814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:49.703814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:49.703814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:49.705938 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 376/762] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:49.715283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd7711-4b03-4757-ba6c-10869b682253 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:49.734350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45c4d6-8c9d-4d13-a1fa-cb7f89a65d51 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:49.786836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33899d-cae9-465f-ba60-bc7d0d46b69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:49.787425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33899d-cae9-465f-ba60-bc7d0d46b69d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:49.787716 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33899d-cae9-465f-ba60-bc7d0d46b69d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:49.788001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33899d-cae9-465f-ba60-bc7d0d46b69d None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:49.788672 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33899d-cae9-465f-ba60-bc7d0d46b69d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:49.788973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33899d-cae9-465f-ba60-bc7d0d46b69d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:49.791123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33899d-cae9-465f-ba60-bc7d0d46b69d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:49.819301 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 387/763] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:49.827104 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33899d-cae9-465f-ba60-bc7d0d46b69d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:49.849291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd7711-4b03-4757-ba6c-10869b682253 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:49.867250 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:49.888910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1dcc3-55f2-4ee6-b49d-d2a8e62f52b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:49.889848 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1dcc3-55f2-4ee6-b49d-d2a8e62f52b4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:49.890293 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1dcc3-55f2-4ee6-b49d-d2a8e62f52b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:49.890704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1dcc3-55f2-4ee6-b49d-d2a8e62f52b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:49.891543 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1dcc3-55f2-4ee6-b49d-d2a8e62f52b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:49.891987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1dcc3-55f2-4ee6-b49d-d2a8e62f52b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:49.893601 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1dcc3-55f2-4ee6-b49d-d2a8e62f52b4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:49.907804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 377/764] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:49.912935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1dcc3-55f2-4ee6-b49d-d2a8e62f52b4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:49.923725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:49.987762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33899d-cae9-465f-ba60-bc7d0d46b69d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:50.022814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed022ab-3496-40f1-ab19-009b68933245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:50.023489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed022ab-3496-40f1-ab19-009b68933245 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:50.023730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed022ab-3496-40f1-ab19-009b68933245 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:50.024555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed022ab-3496-40f1-ab19-009b68933245 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:50.029764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1dcc3-55f2-4ee6-b49d-d2a8e62f52b4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:50.032892 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed022ab-3496-40f1-ab19-009b68933245 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:50.034005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed022ab-3496-40f1-ab19-009b68933245 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:50.046589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-aed022ab-3496-40f1-ab19-009b68933245 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:50.046589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:50.046589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:50.046589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:50.046589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:50.046589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:50.046589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:50.046589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:50.046589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:50.046589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:50.046589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:50.046589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:50.046589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:50.046589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:50.046589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:50.047680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:50.047680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:50.047680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:50.047680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:50.047680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:50.047680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:50.047680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:50.047680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:50.047680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:50.047680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:50.047680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:50.047680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:50.047680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:50.047680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:50.047680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:50.047680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:50.047680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:50.048710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:50.048710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:50.048710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:50.048710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:50.048710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:50.048710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:50.048710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:50.048710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:50.052561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 388/765] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:50.053401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed022ab-3496-40f1-ab19-009b68933245 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:50.069162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946d8e5-6b67-4d2b-8acd-d103bfde6e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:50.070164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946d8e5-6b67-4d2b-8acd-d103bfde6e48 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:50.070583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946d8e5-6b67-4d2b-8acd-d103bfde6e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:50.071022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946d8e5-6b67-4d2b-8acd-d103bfde6e48 None admin] PATH_INFO: `/v3/services/network` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:50.071761 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946d8e5-6b67-4d2b-8acd-d103bfde6e48 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:50.073411 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946d8e5-6b67-4d2b-8acd-d103bfde6e48 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:50.085489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-8946d8e5-6b67-4d2b-8acd-d103bfde6e48 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:12:50.085489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:50.085489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:12:50.085489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:12:50.085489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:12:50.085489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:12:50.085489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:12:50.085489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:12:50.085489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:12:50.085489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:50.085489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:12:50.085489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:50.085489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:50.085489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:50.085489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:50.085489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:50.085489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:50.087298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:50.087298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:50.087298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:50.087298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:50.087298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:50.087298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:50.087298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:12:50.087298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:12:50.087298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:12:50.087298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:12:50.087298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:50.087298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:50.087298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:50.087298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:50.087298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:50.087298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:50.088365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:50.088365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:50.088365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:50.088365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:50.088365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:50.088365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:50.088365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:50.088365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:50.088365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:50.088365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:50.088365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:12:50.088365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:12:50.088365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:12:50.088365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:50.090843 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 378/766] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:49 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:50.091778 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946d8e5-6b67-4d2b-8acd-d103bfde6e48 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:50.135076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:50.162526 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed022ab-3496-40f1-ab19-009b68933245 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:50.184602 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:50.207747 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bacda8-4308-44f4-889c-349f52035e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:50.208358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bacda8-4308-44f4-889c-349f52035e91 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:50.208633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bacda8-4308-44f4-889c-349f52035e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:50.208903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bacda8-4308-44f4-889c-349f52035e91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:50.210281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bacda8-4308-44f4-889c-349f52035e91 None admin] RBAC: Adding query filter params (role.id=bbf63b75406649a3b653308ecb75062d, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=5fe3a02c2bc247efa354ca5bac39ec4e) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:50.210592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bacda8-4308-44f4-889c-349f52035e91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:50.212294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bacda8-4308-44f4-889c-349f52035e91 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:50.218409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946d8e5-6b67-4d2b-8acd-d103bfde6e48 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:50.226099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 389/767] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:12:50 2022] GET /identity/v3/role_assignments?user.id=5fe3a02c2bc247efa354ca5bac39ec4e&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=bbf63b75406649a3b653308ecb75062d => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:50.226099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bacda8-4308-44f4-889c-349f52035e91 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:50.304096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2084a8-8dc5-4b4e-b5af-3377ba10e826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:50.305992 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2084a8-8dc5-4b4e-b5af-3377ba10e826 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:50.306501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2084a8-8dc5-4b4e-b5af-3377ba10e826 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:50.307003 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2084a8-8dc5-4b4e-b5af-3377ba10e826 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:50.307902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2084a8-8dc5-4b4e-b5af-3377ba10e826 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:50.308390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2084a8-8dc5-4b4e-b5af-3377ba10e826 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:50.310096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2084a8-8dc5-4b4e-b5af-3377ba10e826 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:50.339135 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 379/768] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:50.345409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2084a8-8dc5-4b4e-b5af-3377ba10e826 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:50.348112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bacda8-4308-44f4-889c-349f52035e91 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:50.389732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3a42e-6ac4-4440-803d-6d6152b806f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:50.391479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3a42e-6ac4-4440-803d-6d6152b806f3 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:50.391479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3a42e-6ac4-4440-803d-6d6152b806f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:50.391479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3a42e-6ac4-4440-803d-6d6152b806f3 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:50.392018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3a42e-6ac4-4440-803d-6d6152b806f3 None admin] RBAC: Adding query filter params (name=network) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:50.392321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3a42e-6ac4-4440-803d-6d6152b806f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:50.398095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3a42e-6ac4-4440-803d-6d6152b806f3 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:50.399742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 390/769] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 16:12:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:50.405929 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3a42e-6ac4-4440-803d-6d6152b806f3 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:50.409452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:50.526438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2084a8-8dc5-4b4e-b5af-3377ba10e826 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:50.547534 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3a42e-6ac4-4440-803d-6d6152b806f3 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:50.559701 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:50.572146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dadf5-52b0-481c-9c76-375506c0ea5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:50.573032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dadf5-52b0-481c-9c76-375506c0ea5f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:50.573454 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dadf5-52b0-481c-9c76-375506c0ea5f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:50.573881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dadf5-52b0-481c-9c76-375506c0ea5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:50.575019 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dadf5-52b0-481c-9c76-375506c0ea5f None admin] RBAC: Adding query filter params (role.id=8de0c87242d7426ea25a510b578c02aa, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=e7fb290911bc4de887d04b71731f76b5) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:50.575745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dadf5-52b0-481c-9c76-375506c0ea5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:50.577393 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dadf5-52b0-481c-9c76-375506c0ea5f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:50.590096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b519f-240a-484b-9513-a7e04dbfce53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:50.590096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b519f-240a-484b-9513-a7e04dbfce53 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:50.590096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b519f-240a-484b-9513-a7e04dbfce53 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:50.590096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b519f-240a-484b-9513-a7e04dbfce53 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:50.590561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b519f-240a-484b-9513-a7e04dbfce53 None admin] RBAC: Adding query filter params (type=network) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:50.590561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b519f-240a-484b-9513-a7e04dbfce53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:50.590782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b519f-240a-484b-9513-a7e04dbfce53 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:50.590887 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 380/770] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:12:50 2022] GET /identity/v3/role_assignments?user.id=e7fb290911bc4de887d04b71731f76b5&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=8de0c87242d7426ea25a510b578c02aa => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:50.592608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23c0b9-f396-4d65-98d3-47631eac1840 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:50.593081 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23c0b9-f396-4d65-98d3-47631eac1840 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:50.593494 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23c0b9-f396-4d65-98d3-47631eac1840 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:50.595095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 381/771] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:50.600947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d070d-5e08-4763-b549-af1b3855c209 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:50.601455 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d070d-5e08-4763-b549-af1b3855c209 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:50.601871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d070d-5e08-4763-b549-af1b3855c209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:50.602539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 391/772] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 16:12:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:50.604114 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b519f-240a-484b-9513-a7e04dbfce53 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:50.637908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7c9d070d-5e08-4763-b549-af1b3855c209 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:50.639522 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7c9d070d-5e08-4763-b549-af1b3855c209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:50.680503 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:50.737855 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b519f-240a-484b-9513-a7e04dbfce53 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:50.785818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 382/773] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:12:50.800355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f751b-03be-4843-bc7a-8bdcb178b4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:50.800994 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f751b-03be-4843-bc7a-8bdcb178b4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:50.801284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f751b-03be-4843-bc7a-8bdcb178b4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:50.801567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f751b-03be-4843-bc7a-8bdcb178b4b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:50.802329 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f751b-03be-4843-bc7a-8bdcb178b4b0 None admin] RBAC: Adding query filter params (interface=public, service_id=58d53142836943cf882e0f50ec3e909c, region_id=RegionOne) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:50.802649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f751b-03be-4843-bc7a-8bdcb178b4b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:50.804092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f751b-03be-4843-bc7a-8bdcb178b4b0 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:50.817711 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 392/774] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 23 16:12:50 2022] GET /identity/v3/endpoints?service_id=58d53142836943cf882e0f50ec3e909c&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:50.819057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d070d-5e08-4763-b549-af1b3855c209 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:50.824084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15164bfa-a615-4792-b082-4dc48d557463 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:50.824376 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15164bfa-a615-4792-b082-4dc48d557463 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:50.824656 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15164bfa-a615-4792-b082-4dc48d557463 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:50.826305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 393/775] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:50.833211 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3edb1-9d1f-4379-8f34-6a095fb7ffb8 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:50.833495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3edb1-9d1f-4379-8f34-6a095fb7ffb8 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:50.833765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3edb1-9d1f-4379-8f34-6a095fb7ffb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:50.854239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-79b3edb1-9d1f-4379-8f34-6a095fb7ffb8 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:50.855475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-79b3edb1-9d1f-4379-8f34-6a095fb7ffb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:50.934449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 394/776] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:12:50.952275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d070d-5e08-4763-b549-af1b3855c209 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:50.977148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:50.988535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3572858-7406-45a5-b737-e5e3c69a8bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:50.989147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3572858-7406-45a5-b737-e5e3c69a8bfc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:50.989431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3572858-7406-45a5-b737-e5e3c69a8bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:50.989704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3572858-7406-45a5-b737-e5e3c69a8bfc None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:50.990368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3572858-7406-45a5-b737-e5e3c69a8bfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:50.991739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3572858-7406-45a5-b737-e5e3c69a8bfc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:51.002312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 383/777] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 23 16:12:50 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:51.184793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3edb1-9d1f-4379-8f34-6a095fb7ffb8 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:51.263529 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3572858-7406-45a5-b737-e5e3c69a8bfc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:51.265977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:51.341553 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3edb1-9d1f-4379-8f34-6a095fb7ffb8 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:51.414445 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9d26a-df90-44be-8ddd-b8c2a8daaa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:51.415857 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9d26a-df90-44be-8ddd-b8c2a8daaa13 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:51.416166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9d26a-df90-44be-8ddd-b8c2a8daaa13 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:51.416468 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9d26a-df90-44be-8ddd-b8c2a8daaa13 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:51.417059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9d26a-df90-44be-8ddd-b8c2a8daaa13 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:51.418449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9d26a-df90-44be-8ddd-b8c2a8daaa13 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:51.437408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-28c9d26a-df90-44be-8ddd-b8c2a8daaa13 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:12:51.437408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:51.437408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:12:51.437408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:12:51.437408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:12:51.437408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:12:51.437408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:12:51.437408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:12:51.437408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:12:51.437408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:51.437408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:12:51.437408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:51.437408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:51.437408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:51.437408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:51.437408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:51.437408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:51.438466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:51.438466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:51.438466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:51.438466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:51.438466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:51.438466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:51.438466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:12:51.438466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:12:51.438466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:12:51.438466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:12:51.438466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:51.438466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:51.438466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:51.438466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:51.438466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:51.438466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:51.439307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:51.439307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:51.439307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:51.439307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:51.439307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:51.439307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:51.439307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:51.439307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:51.439307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:51.439307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:51.439307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:12:51.439307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:12:51.439307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:12:51.439307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:51.439307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 395/778] 10.222.0.16 () {56 vars in 1129 bytes} [Tue Aug 23 16:12:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:51.446360 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9d26a-df90-44be-8ddd-b8c2a8daaa13 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:51.448582 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3572858-7406-45a5-b737-e5e3c69a8bfc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:51.535403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0eb345-bdd9-4705-990d-065197c8468c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:51.536435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eb345-bdd9-4705-990d-065197c8468c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:51.536947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eb345-bdd9-4705-990d-065197c8468c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:51.537420 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eb345-bdd9-4705-990d-065197c8468c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:51.558043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9d26a-df90-44be-8ddd-b8c2a8daaa13 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:51.566188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0eb345-bdd9-4705-990d-065197c8468c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:51.578935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-cd0eb345-bdd9-4705-990d-065197c8468c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:12:51.578935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:51.578935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:51.578935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:51.578935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:51.578935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:51.578935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:51.578935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:51.578935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:51.578935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:51.578935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:51.578935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:51.578935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:51.578935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:51.578935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:51.578935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:51.580001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:51.580001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:51.580001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:51.580001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:51.580001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:51.580001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:51.580001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:51.580001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:51.580001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:51.580001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:51.580001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:51.580001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:51.580001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:51.580001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:51.580001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:51.580001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:51.580853 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:51.580853 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:51.580853 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:51.580853 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:51.580853 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:51.580853 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:51.580853 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:51.580853 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:51.580853 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:51.580853 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:51.580853 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:12:51.580853 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:51.580853 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 384/779] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:12:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:51.590322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:51.595720 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0eb345-bdd9-4705-990d-065197c8468c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:51.609396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaa548-9eb1-4c79-bdf5-66cd45d0efc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:51.610022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaa548-9eb1-4c79-bdf5-66cd45d0efc4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:51.610339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaa548-9eb1-4c79-bdf5-66cd45d0efc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:51.610599 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaa548-9eb1-4c79-bdf5-66cd45d0efc4 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:51.611237 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caaa548-9eb1-4c79-bdf5-66cd45d0efc4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:51.611536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caaa548-9eb1-4c79-bdf5-66cd45d0efc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:51.612928 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caaa548-9eb1-4c79-bdf5-66cd45d0efc4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:51.626451 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 396/780] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 23 16:12:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:51.631215 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaa548-9eb1-4c79-bdf5-66cd45d0efc4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:51.692824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:51.749907 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaa548-9eb1-4c79-bdf5-66cd45d0efc4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:51.787301 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d521d-8a57-4568-b9ae-3c65e58fffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:51.787906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d521d-8a57-4568-b9ae-3c65e58fffd8 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:51.788294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d521d-8a57-4568-b9ae-3c65e58fffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:51.788722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d521d-8a57-4568-b9ae-3c65e58fffd8 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:51.789405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d521d-8a57-4568-b9ae-3c65e58fffd8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:51.790077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d521d-8a57-4568-b9ae-3c65e58fffd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:51.791798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d521d-8a57-4568-b9ae-3c65e58fffd8 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:51.797374 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 397/781] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 23 16:12:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:51.803157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d521d-8a57-4568-b9ae-3c65e58fffd8 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:51.828719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0eb345-bdd9-4705-990d-065197c8468c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:51.862934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:51.917311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d521d-8a57-4568-b9ae-3c65e58fffd8 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:51.921500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86975a-efee-4be1-8ae6-a92eae29f720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:51.922382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86975a-efee-4be1-8ae6-a92eae29f720 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:51.922891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86975a-efee-4be1-8ae6-a92eae29f720 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:51.923360 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86975a-efee-4be1-8ae6-a92eae29f720 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:51.924254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86975a-efee-4be1-8ae6-a92eae29f720 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:51.924757 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86975a-efee-4be1-8ae6-a92eae29f720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:51.926340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86975a-efee-4be1-8ae6-a92eae29f720 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:51.945649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 385/782] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:51.952548 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86975a-efee-4be1-8ae6-a92eae29f720 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:51.960109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b78834-28b2-4bf1-b633-5967f001c628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:51.960833 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b78834-28b2-4bf1-b633-5967f001c628 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:51.961116 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b78834-28b2-4bf1-b633-5967f001c628 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:51.961983 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b78834-28b2-4bf1-b633-5967f001c628 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:51.966091 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b78834-28b2-4bf1-b633-5967f001c628 None admin] RBAC: Adding query filter params (interface=public, service_id=9799628e20b04fe58387483df9fd6fe2, region_id=RegionOne) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:51.966091 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b78834-28b2-4bf1-b633-5967f001c628 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:51.966091 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b78834-28b2-4bf1-b633-5967f001c628 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:51.970636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 398/783] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 23 16:12:51 2022] GET /identity/v3/endpoints?service_id=9799628e20b04fe58387483df9fd6fe2&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:51.976081 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b78834-28b2-4bf1-b633-5967f001c628 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:52.093395 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b78834-28b2-4bf1-b633-5967f001c628 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:52.108840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86975a-efee-4be1-8ae6-a92eae29f720 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:52.112169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:52.120415 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:52.136793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4c4f5-38df-405e-9760-5afc7e1fa04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:52.137814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c4f5-38df-405e-9760-5afc7e1fa04c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:52.138390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c4f5-38df-405e-9760-5afc7e1fa04c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:52.138878 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c4f5-38df-405e-9760-5afc7e1fa04c None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:52.139679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4c4f5-38df-405e-9760-5afc7e1fa04c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:52.141469 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4c4f5-38df-405e-9760-5afc7e1fa04c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:52.145764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ca685-a267-4d5b-b405-9d6c5947e109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:52.146427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ca685-a267-4d5b-b405-9d6c5947e109 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:52.146706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ca685-a267-4d5b-b405-9d6c5947e109 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:52.146979 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ca685-a267-4d5b-b405-9d6c5947e109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:52.148966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 399/784] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 23 16:12:51 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:12:52.159487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ca685-a267-4d5b-b405-9d6c5947e109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:52.160978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ca685-a267-4d5b-b405-9d6c5947e109 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:52.190689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-8a5ca685-a267-4d5b-b405-9d6c5947e109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:52.190689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:52.190689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:52.190689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:52.190689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:52.190689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:52.190689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:52.190689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:52.190689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:52.190689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:52.190689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:52.190689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:52.190689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:52.190689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:52.190689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:52.190689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:52.191683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:52.191683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:52.191683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:52.191683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:52.191683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:52.191683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:52.191683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:52.191683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:52.191683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:52.191683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:52.191683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:52.191683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:52.191683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:52.191683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:52.191683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:52.191683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:52.191683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:52.192577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:52.192577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:52.192577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:52.196346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 386/785] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:12:52.199736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4c4f5-38df-405e-9760-5afc7e1fa04c None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:52.383141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4c4f5-38df-405e-9760-5afc7e1fa04c None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:52.426770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6dd66-fec8-40ba-82d0-2d1bde2eeb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:52.427399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6dd66-fec8-40ba-82d0-2d1bde2eeb86 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:52.427640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6dd66-fec8-40ba-82d0-2d1bde2eeb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:52.427918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6dd66-fec8-40ba-82d0-2d1bde2eeb86 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:52.428562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6dd66-fec8-40ba-82d0-2d1bde2eeb86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:52.428865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6dd66-fec8-40ba-82d0-2d1bde2eeb86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:52.430790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6dd66-fec8-40ba-82d0-2d1bde2eeb86 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:52.445482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 400/786] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:52.455234 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ca685-a267-4d5b-b405-9d6c5947e109 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:52.616837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ca685-a267-4d5b-b405-9d6c5947e109 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:52.668753 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e815b-9994-46d7-be7a-96d0611ce2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:52.669400 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e815b-9994-46d7-be7a-96d0611ce2a2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:52.669683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e815b-9994-46d7-be7a-96d0611ce2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:52.669954 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e815b-9994-46d7-be7a-96d0611ce2a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:52.680404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e815b-9994-46d7-be7a-96d0611ce2a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:52.681929 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e815b-9994-46d7-be7a-96d0611ce2a2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:52.696736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-9c2e815b-9994-46d7-be7a-96d0611ce2a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:12:52.696736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:52.696736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:52.696736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:52.696736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:52.696736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:52.696736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:52.696736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:52.696736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:52.696736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:52.696736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:52.696736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:52.696736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:52.696736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:52.696736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:52.696736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:52.698029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:52.698029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:52.698029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:52.698029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:52.698029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:52.698029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:52.698029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:52.698029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:52.698029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:52.698029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:52.698029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:52.698029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:52.698029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:52.698029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:52.698029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:52.698029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:52.698029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:52.698029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:52.698991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:52.698991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:52.698991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:52.698991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:52.698991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:52.698991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:52.698991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:52.698991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:52.698991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:12:52.698991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:52.700998 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 387/787] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 23 16:12:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:52.705966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6dd66-fec8-40ba-82d0-2d1bde2eeb86 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:52.763356 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:52.808810 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79772c2-941b-44a2-b91a-0107c903b76d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:52.809124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79772c2-941b-44a2-b91a-0107c903b76d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:52.809360 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79772c2-941b-44a2-b91a-0107c903b76d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:52.812022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 388/788] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:12:52.816156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893c69f-36f7-4744-9781-d1fa3751d56b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:52.816445 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893c69f-36f7-4744-9781-d1fa3751d56b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:52.816722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893c69f-36f7-4744-9781-d1fa3751d56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:52.834801 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6dd66-fec8-40ba-82d0-2d1bde2eeb86 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:52.846392 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c893c69f-36f7-4744-9781-d1fa3751d56b None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:52.847601 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c893c69f-36f7-4744-9781-d1fa3751d56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:52.876856 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075e13e-fd46-45fb-a777-e03426685807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:52.877474 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075e13e-fd46-45fb-a777-e03426685807 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:52.877755 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075e13e-fd46-45fb-a777-e03426685807 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:52.878029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075e13e-fd46-45fb-a777-e03426685807 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:52.878788 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075e13e-fd46-45fb-a777-e03426685807 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:52.879097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075e13e-fd46-45fb-a777-e03426685807 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:52.880525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075e13e-fd46-45fb-a777-e03426685807 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:52.893783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:52.920923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 401/789] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 23 16:12:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:52.925869 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075e13e-fd46-45fb-a777-e03426685807 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:52.984001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 389/790] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:12:52.989748 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675e949-1fbd-48e1-99f8-34cf7bdb7659 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:52.990093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675e949-1fbd-48e1-99f8-34cf7bdb7659 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:52.990333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675e949-1fbd-48e1-99f8-34cf7bdb7659 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:52.992007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 390/791] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:12:52.997750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f694e-4873-4a52-ba9b-987669f09ecd None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:52.998079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f694e-4873-4a52-ba9b-987669f09ecd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:52.998338 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f694e-4873-4a52-ba9b-987669f09ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:53.026951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5a0f694e-4873-4a52-ba9b-987669f09ecd None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:53.028156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5a0f694e-4873-4a52-ba9b-987669f09ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:53.042003 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:53.045970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075e13e-fd46-45fb-a777-e03426685807 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:53.083553 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d8490-deb9-449c-bffe-c5b9429f7087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:53.084256 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d8490-deb9-449c-bffe-c5b9429f7087 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:53.084608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d8490-deb9-449c-bffe-c5b9429f7087 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:53.084953 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d8490-deb9-449c-bffe-c5b9429f7087 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:53.132628 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 391/792] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:12:53.156905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d8490-deb9-449c-bffe-c5b9429f7087 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:53.164191 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d8490-deb9-449c-bffe-c5b9429f7087 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:53.273301 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 402/793] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:12:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:12:53.273598 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:53.279756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f694e-4873-4a52-ba9b-987669f09ecd None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:53.340879 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d8490-deb9-449c-bffe-c5b9429f7087 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:53.438206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:53.471574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f694e-4873-4a52-ba9b-987669f09ecd None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:53.485241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d8490-deb9-449c-bffe-c5b9429f7087 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:53.518815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad246e3-d90c-4875-9625-78cda866ad28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:53.519793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad246e3-d90c-4875-9625-78cda866ad28 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:53.520281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad246e3-d90c-4875-9625-78cda866ad28 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:53.520742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad246e3-d90c-4875-9625-78cda866ad28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:53.525426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05410426-df4d-4b94-b5d6-c3d3321af8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:53.525997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410426-df4d-4b94-b5d6-c3d3321af8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:53.526317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410426-df4d-4b94-b5d6-c3d3321af8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:53.526592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410426-df4d-4b94-b5d6-c3d3321af8d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:53.532314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad246e3-d90c-4875-9625-78cda866ad28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:53.534017 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad246e3-d90c-4875-9625-78cda866ad28 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:53.537913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05410426-df4d-4b94-b5d6-c3d3321af8d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:53.542736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-05410426-df4d-4b94-b5d6-c3d3321af8d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:53.542736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:53.542736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:53.542736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:53.542736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:53.542736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:53.542736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:53.542736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:53.542736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:53.542736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:53.542736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:53.542736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:53.542736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:53.542736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:53.542736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:53.542736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:53.543851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:53.543851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:53.543851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:53.543851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:53.543851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:53.543851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:53.543851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:53.543851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:53.543851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:53.543851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:53.543851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:53.543851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:53.543851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:53.543851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:53.543851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:53.543851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:53.544718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:53.544718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:53.544718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:53.544718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:53.544718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:53.544718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:53.544718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:53.544718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:53.544718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:53.544718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:53.544718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:53.544718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:53.544718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 403/794] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:12:53.545404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22d0a6-ca91-44db-b035-97b28711d1e2 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:53.545639 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22d0a6-ca91-44db-b035-97b28711d1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:53.545914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22d0a6-ca91-44db-b035-97b28711d1e2 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:53.550107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 404/795] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:53.550107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22d0a6-ca91-44db-b035-97b28711d1e2 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:53.556326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-6ad246e3-d90c-4875-9625-78cda866ad28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:53.556326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:53.556326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:53.556326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:53.556326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:53.556326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:53.556326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:53.556326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:53.556326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:53.556326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:53.556326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:53.556326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:53.556326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:53.556326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:53.556326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:53.556326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:53.557290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:53.557290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:53.557290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:53.557290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:53.557290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:53.557290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:53.557290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:53.557290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:53.557290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:53.557290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:53.557290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:53.557290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:53.557290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:53.557290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:53.557290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:53.557290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:53.557290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:53.558188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:53.558188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:53.558188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:53.558188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 392/796] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:53.558815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad246e3-d90c-4875-9625-78cda866ad28 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:53.616188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:53.663474 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22d0a6-ca91-44db-b035-97b28711d1e2 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:53.675641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad246e3-d90c-4875-9625-78cda866ad28 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:53.701319 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f73c0-4573-4d6c-958f-a9b04e69161b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:53.701943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f73c0-4573-4d6c-958f-a9b04e69161b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:53.702250 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f73c0-4573-4d6c-958f-a9b04e69161b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:53.702520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f73c0-4573-4d6c-958f-a9b04e69161b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:53.713313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b7186-0588-4cdb-a2e7-742d960777af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:53.713920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b7186-0588-4cdb-a2e7-742d960777af None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:53.714260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b7186-0588-4cdb-a2e7-742d960777af None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:53.714450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f73c0-4573-4d6c-958f-a9b04e69161b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:53.714574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b7186-0588-4cdb-a2e7-742d960777af None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:53.715181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b7186-0588-4cdb-a2e7-742d960777af None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:53.715483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b7186-0588-4cdb-a2e7-742d960777af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:53.716820 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b7186-0588-4cdb-a2e7-742d960777af None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:53.718324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:53.719317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-bc1f73c0-4573-4d6c-958f-a9b04e69161b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:12:53.719317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:53.719317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:53.719317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:53.719317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:53.719317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:53.719317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:53.719317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:53.719317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:53.719317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:53.719317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:53.719317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:53.719317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:53.719317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:53.719317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:53.719317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:53.720299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:53.720299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:53.720299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:53.720299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:53.720299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:53.720299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:53.720299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:53.720299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:53.720299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:53.720299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:53.720299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:53.720299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:53.720299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:53.720299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:53.720299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:53.720299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:53.721119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:53.721119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:53.721119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:53.721119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:53.721119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:53.721119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:53.721119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:53.721119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:53.721119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:53.721119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:53.721119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:12:53.721119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:53.721119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 405/797] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:12:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:53.721827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e020-f86f-4fc6-aea2-620d4f69135e None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:53.721827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e020-f86f-4fc6-aea2-620d4f69135e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:53.721827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e020-f86f-4fc6-aea2-620d4f69135e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:53.737569 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 393/798] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:53.737569 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b7186-0588-4cdb-a2e7-742d960777af None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:53.745050 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-51f9e020-f86f-4fc6-aea2-620d4f69135e None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:53.746321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-51f9e020-f86f-4fc6-aea2-620d4f69135e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:53.820057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 406/799] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:12:53.821392 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9e020-f86f-4fc6-aea2-620d4f69135e None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:53.853164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b7186-0588-4cdb-a2e7-742d960777af None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:53.890191 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af2c86-77c1-4fe0-ad5f-473e0eaa25eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:53.890895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af2c86-77c1-4fe0-ad5f-473e0eaa25eb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:53.891243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af2c86-77c1-4fe0-ad5f-473e0eaa25eb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:53.891584 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af2c86-77c1-4fe0-ad5f-473e0eaa25eb None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:53.892295 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af2c86-77c1-4fe0-ad5f-473e0eaa25eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:53.892686 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af2c86-77c1-4fe0-ad5f-473e0eaa25eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:53.894131 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af2c86-77c1-4fe0-ad5f-473e0eaa25eb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:53.896361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:53.907796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 394/800] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:53.908973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af2c86-77c1-4fe0-ad5f-473e0eaa25eb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:53.964337 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9e020-f86f-4fc6-aea2-620d4f69135e None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:53.967682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:54.015103 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124383c-3990-4ce8-9e8d-ce816d45468c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:54.016109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124383c-3990-4ce8-9e8d-ce816d45468c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:54.016218 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af2c86-77c1-4fe0-ad5f-473e0eaa25eb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:54.016667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124383c-3990-4ce8-9e8d-ce816d45468c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:54.017161 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124383c-3990-4ce8-9e8d-ce816d45468c None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:54.018313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124383c-3990-4ce8-9e8d-ce816d45468c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:54.019781 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124383c-3990-4ce8-9e8d-ce816d45468c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:54.021438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124383c-3990-4ce8-9e8d-ce816d45468c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:54.033960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 407/801] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:54.035651 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124383c-3990-4ce8-9e8d-ce816d45468c None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:54.052876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0f6fc-1089-4327-80f9-952ea9be8fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:54.053611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0f6fc-1089-4327-80f9-952ea9be8fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:54.053963 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0f6fc-1089-4327-80f9-952ea9be8fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:54.054334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0f6fc-1089-4327-80f9-952ea9be8fe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:54.065522 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0f6fc-1089-4327-80f9-952ea9be8fe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:54.067066 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0f6fc-1089-4327-80f9-952ea9be8fe8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:54.082717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5eb0f6fc-1089-4327-80f9-952ea9be8fe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:54.082717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:54.082717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:54.082717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:54.082717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:54.082717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:54.082717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:54.082717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:54.082717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:54.082717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:54.082717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:54.082717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:54.082717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:54.082717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:54.082717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:54.082717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:54.083770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:54.083770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:54.083770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:54.083770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:54.083770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:54.083770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:54.083770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:54.083770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:54.083770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:54.083770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:54.083770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:54.083770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:54.083770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:54.083770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:54.083770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:54.083770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:54.083770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:54.084667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:54.084667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:54.084667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:54.088563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 395/802] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:54.089507 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0f6fc-1089-4327-80f9-952ea9be8fe8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:54.163456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124383c-3990-4ce8-9e8d-ce816d45468c None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:54.176346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:54.202987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b025d37-ba53-4e54-9c2f-d36e111e49bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:54.203613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b025d37-ba53-4e54-9c2f-d36e111e49bc None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:54.203890 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b025d37-ba53-4e54-9c2f-d36e111e49bc None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:54.204157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b025d37-ba53-4e54-9c2f-d36e111e49bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:54.210979 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b025d37-ba53-4e54-9c2f-d36e111e49bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:54.213722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b025d37-ba53-4e54-9c2f-d36e111e49bc None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:54.220738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0f6fc-1089-4327-80f9-952ea9be8fe8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:54.225136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-5b025d37-ba53-4e54-9c2f-d36e111e49bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:54.225136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:54.225136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:54.225136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:54.225136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:54.225136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:54.225136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:54.225136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:54.225136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:54.225136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:54.225136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:54.225136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:54.225136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:54.225136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:54.225136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:54.226005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:54.226005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:54.226005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:54.226005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:54.226005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:54.226005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:54.226005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:54.226005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:54.226005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:54.226005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:54.226005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:54.226005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:54.226005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:54.226005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:54.226005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:54.226005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:54.226005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:54.227570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:54.227570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:54.227570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:54.227570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:54.227570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:54.227570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:54.227570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:54.227570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:54.227570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 408/803] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:54.231166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:54.232154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b025d37-ba53-4e54-9c2f-d36e111e49bc None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:54.259428 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165f780-89d2-4786-8add-5408bd2d120c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:54.260319 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165f780-89d2-4786-8add-5408bd2d120c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:54.260319 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165f780-89d2-4786-8add-5408bd2d120c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:54.260578 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165f780-89d2-4786-8add-5408bd2d120c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:54.272630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165f780-89d2-4786-8add-5408bd2d120c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:54.274849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165f780-89d2-4786-8add-5408bd2d120c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:54.289305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-f165f780-89d2-4786-8add-5408bd2d120c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:54.289305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:54.289305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:54.289305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:54.289305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:54.289305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:54.289305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:54.289305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:54.289305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:54.289305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:54.289305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:54.289305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:54.289305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:54.289305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:54.289305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:54.289305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:54.290895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:54.290895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:54.290895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:54.290895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:54.290895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:54.290895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:54.290895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:54.290895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:54.290895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:54.290895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:54.290895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:54.290895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:54.290895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:54.290895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:54.290895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:54.290895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:54.290895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:54.291816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:54.291816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:54.291816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:54.291816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 396/804] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:54.291816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165f780-89d2-4786-8add-5408bd2d120c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:54.347426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b025d37-ba53-4e54-9c2f-d36e111e49bc None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:54.383273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc863de4-fd59-4f47-b6b1-bd2e4bf497c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:54.383877 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc863de4-fd59-4f47-b6b1-bd2e4bf497c4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:54.384163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc863de4-fd59-4f47-b6b1-bd2e4bf497c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:54.384434 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc863de4-fd59-4f47-b6b1-bd2e4bf497c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:54.385073 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc863de4-fd59-4f47-b6b1-bd2e4bf497c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:54.385389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc863de4-fd59-4f47-b6b1-bd2e4bf497c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:54.386764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc863de4-fd59-4f47-b6b1-bd2e4bf497c4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:54.398645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 409/805] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:54.399282 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc863de4-fd59-4f47-b6b1-bd2e4bf497c4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:54.411683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165f780-89d2-4786-8add-5408bd2d120c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:54.431487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:54.451380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262cb63-035a-4a9a-ba4a-472477c7e1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:54.452388 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262cb63-035a-4a9a-ba4a-472477c7e1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:54.452847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262cb63-035a-4a9a-ba4a-472477c7e1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:54.453328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262cb63-035a-4a9a-ba4a-472477c7e1f2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:54.454116 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262cb63-035a-4a9a-ba4a-472477c7e1f2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:54.455765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262cb63-035a-4a9a-ba4a-472477c7e1f2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:54.466174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2262cb63-035a-4a9a-ba4a-472477c7e1f2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:12:54.466174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:54.466174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:12:54.466174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:12:54.466174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:12:54.466174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:12:54.466174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:12:54.466174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:12:54.466174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:12:54.466174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:54.466174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:12:54.466174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:54.466174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:54.466174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:54.466174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:54.466174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:54.466174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:54.467177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:54.467177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:54.467177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:54.467177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:54.467177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:54.467177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:54.467177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:12:54.467177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:12:54.467177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:12:54.467177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:12:54.467177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:54.467177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:54.467177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:54.467177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:54.467177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:54.467177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:54.467996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:54.467996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:54.467996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:54.467996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:54.467996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:54.467996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:54.467996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:54.467996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:54.467996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:54.467996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:54.467996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:12:54.467996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:12:54.467996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 16:12:54.467996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:54.470531 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 397/806] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:54 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:54.471910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262cb63-035a-4a9a-ba4a-472477c7e1f2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:54.499389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:54.507831 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc863de4-fd59-4f47-b6b1-bd2e4bf497c4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:54.543185 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c5023-377d-4ee0-91fe-3a69faf2fe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:54.543792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c5023-377d-4ee0-91fe-3a69faf2fe82 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:54.544088 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c5023-377d-4ee0-91fe-3a69faf2fe82 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:54.544350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c5023-377d-4ee0-91fe-3a69faf2fe82 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:54.545042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c5023-377d-4ee0-91fe-3a69faf2fe82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:54.545372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c5023-377d-4ee0-91fe-3a69faf2fe82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:54.546830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c5023-377d-4ee0-91fe-3a69faf2fe82 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:54.563298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 410/807] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:54.563298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c5023-377d-4ee0-91fe-3a69faf2fe82 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:54.576716 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262cb63-035a-4a9a-ba4a-472477c7e1f2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:54.611230 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb16f4-5fb7-4d42-8f10-087dff013a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:54.611763 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb16f4-5fb7-4d42-8f10-087dff013a9e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:54.612038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb16f4-5fb7-4d42-8f10-087dff013a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:54.612304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb16f4-5fb7-4d42-8f10-087dff013a9e None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:54.612936 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb16f4-5fb7-4d42-8f10-087dff013a9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:54.613262 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb16f4-5fb7-4d42-8f10-087dff013a9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:54.614641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb16f4-5fb7-4d42-8f10-087dff013a9e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:54.627660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 398/808] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:54.628819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1047781-21b3-4cc9-a2b0-51dcdf324784 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:54.629100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1047781-21b3-4cc9-a2b0-51dcdf324784 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:54.629367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1047781-21b3-4cc9-a2b0-51dcdf324784 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:54.630575 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 399/809] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:54.631258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1047781-21b3-4cc9-a2b0-51dcdf324784 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:54.654868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:54.665391 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c5023-377d-4ee0-91fe-3a69faf2fe82 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:54.700733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25872400-4bbb-45c6-95d0-342df0c74a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:54.701600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25872400-4bbb-45c6-95d0-342df0c74a3a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:54.702044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25872400-4bbb-45c6-95d0-342df0c74a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:54.702352 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25872400-4bbb-45c6-95d0-342df0c74a3a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:54.709694 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25872400-4bbb-45c6-95d0-342df0c74a3a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:54.711702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25872400-4bbb-45c6-95d0-342df0c74a3a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:54.719353 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:54.722585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-25872400-4bbb-45c6-95d0-342df0c74a3a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:12:54.722585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:54.722585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:54.722585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:54.722585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:54.722585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:54.722585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:54.722585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:54.722585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:54.722585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:54.722585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:54.722585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:54.722585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:54.722585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:54.722585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:54.722585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:54.723520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:54.723520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:54.723520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:54.723520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:54.723520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:54.723520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:54.723520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:54.723520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:54.723520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:54.723520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:54.723520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:54.723520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:54.723520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:54.723520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:54.723520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:54.723520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:54.723520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:54.723520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:54.724572 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:54.724572 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:54.724572 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:54.724572 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:54.724572 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:54.724572 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:54.724572 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:54.724572 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:54.724572 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:12:54.724572 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:54.724572 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 411/810] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 23 16:12:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:54.724572 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25872400-4bbb-45c6-95d0-342df0c74a3a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:54.740165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1047781-21b3-4cc9-a2b0-51dcdf324784 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:54.773274 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09c2de-9ccb-4637-a6e8-3c8e312c3c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:54.774537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09c2de-9ccb-4637-a6e8-3c8e312c3c52 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:54.774784 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09c2de-9ccb-4637-a6e8-3c8e312c3c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:54.775055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09c2de-9ccb-4637-a6e8-3c8e312c3c52 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:54.775684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09c2de-9ccb-4637-a6e8-3c8e312c3c52 None admin] RBAC: Adding query filter params (name=network) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:54.775984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09c2de-9ccb-4637-a6e8-3c8e312c3c52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:54.777333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09c2de-9ccb-4637-a6e8-3c8e312c3c52 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:54.781698 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 400/811] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 16:12:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:54.782492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09c2de-9ccb-4637-a6e8-3c8e312c3c52 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:54.826999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25872400-4bbb-45c6-95d0-342df0c74a3a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:54.860085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8660be-0786-496a-b673-7c25d504fd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:54.860674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8660be-0786-496a-b673-7c25d504fd18 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:54.860953 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8660be-0786-496a-b673-7c25d504fd18 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:54.861220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8660be-0786-496a-b673-7c25d504fd18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:54.861991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8660be-0786-496a-b673-7c25d504fd18 None admin] RBAC: Adding query filter params (role.id=8de0c87242d7426ea25a510b578c02aa, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=767ca33ca8e244f8a0cc773e3b6abefb) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:54.862266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8660be-0786-496a-b673-7c25d504fd18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:54.863685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8660be-0786-496a-b673-7c25d504fd18 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:54.870047 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 412/812] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:12:54 2022] GET /identity/v3/role_assignments?user.id=767ca33ca8e244f8a0cc773e3b6abefb&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=8de0c87242d7426ea25a510b578c02aa => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:54.871046 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc779f-32ce-4d5f-8fd4-19c5cbdc19cb None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:54.871325 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc779f-32ce-4d5f-8fd4-19c5cbdc19cb None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:54.871594 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc779f-32ce-4d5f-8fd4-19c5cbdc19cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:54.891525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-60bc779f-32ce-4d5f-8fd4-19c5cbdc19cb None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:54.892774 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-60bc779f-32ce-4d5f-8fd4-19c5cbdc19cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:54.897189 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09c2de-9ccb-4637-a6e8-3c8e312c3c52 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:54.904729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:54.938349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a848af5-89dd-401a-81fd-c7f80e53e978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:54.939001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a848af5-89dd-401a-81fd-c7f80e53e978 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:54.939339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a848af5-89dd-401a-81fd-c7f80e53e978 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:54.939615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a848af5-89dd-401a-81fd-c7f80e53e978 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:54.948364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a848af5-89dd-401a-81fd-c7f80e53e978 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:54.950052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a848af5-89dd-401a-81fd-c7f80e53e978 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:54.964899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-8a848af5-89dd-401a-81fd-c7f80e53e978 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:12:54.964899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:54.964899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:54.964899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:54.964899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:54.964899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:54.964899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:54.964899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:54.964899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:54.964899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:54.964899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:54.964899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:54.964899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:12:54.964899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:12:54.964899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:12:54.964899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:12:54.966143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:54.966143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:54.966143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:12:54.966143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:54.966143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:12:54.966143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:12:54.966143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:54.966143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:54.966143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:54.966143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:54.966143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:54.966143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:54.966143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:54.966143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:54.966143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:54.966143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:54.966143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:54.966143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:54.967384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:54.967384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:54.967384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:12:54.967384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:12:54.967384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:12:54.967384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:12:54.967384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:12:54.967384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:12:54.967384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:12:54.967384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:54.970815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 401/813] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:12:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:54.971770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a848af5-89dd-401a-81fd-c7f80e53e978 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:54.979043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 413/814] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:12:54.980225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc779f-32ce-4d5f-8fd4-19c5cbdc19cb None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:54.996859 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:55.094483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a848af5-89dd-401a-81fd-c7f80e53e978 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:55.113245 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc779f-32ce-4d5f-8fd4-19c5cbdc19cb None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:55.136700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6729b-86aa-42ec-ba7d-d6a42fcd75a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:55.137314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6729b-86aa-42ec-ba7d-d6a42fcd75a3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:55.137592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6729b-86aa-42ec-ba7d-d6a42fcd75a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:55.137865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6729b-86aa-42ec-ba7d-d6a42fcd75a3 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:55.138629 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6729b-86aa-42ec-ba7d-d6a42fcd75a3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:55.138938 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6729b-86aa-42ec-ba7d-d6a42fcd75a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:55.140367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6729b-86aa-42ec-ba7d-d6a42fcd75a3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:55.152600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ed900-57b6-419f-9950-be5eb10256aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:55.153226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ed900-57b6-419f-9950-be5eb10256aa None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:55.153509 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ed900-57b6-419f-9950-be5eb10256aa None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:55.153786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ed900-57b6-419f-9950-be5eb10256aa None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:55.154746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ed900-57b6-419f-9950-be5eb10256aa None admin] RBAC: Adding query filter params (type=network) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:55.155057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ed900-57b6-419f-9950-be5eb10256aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:55.157427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ed900-57b6-419f-9950-be5eb10256aa None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:55.166179 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 402/816] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 23 16:12:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:55.167380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6729b-86aa-42ec-ba7d-d6a42fcd75a3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:55.167974 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 414/816] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 16:12:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:55.174187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ed900-57b6-419f-9950-be5eb10256aa None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:55.189343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:55.252109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:55.301150 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6729b-86aa-42ec-ba7d-d6a42fcd75a3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:55.341688 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01716d-634e-4e6c-a96b-7c7c5f0f419c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:55.342356 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01716d-634e-4e6c-a96b-7c7c5f0f419c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:55.342634 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01716d-634e-4e6c-a96b-7c7c5f0f419c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:55.342903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01716d-634e-4e6c-a96b-7c7c5f0f419c None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:55.343637 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01716d-634e-4e6c-a96b-7c7c5f0f419c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:55.343941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01716d-634e-4e6c-a96b-7c7c5f0f419c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:55.345357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01716d-634e-4e6c-a96b-7c7c5f0f419c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:55.364796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 403/817] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 23 16:12:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:55.365544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01716d-634e-4e6c-a96b-7c7c5f0f419c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:55.428782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ed900-57b6-419f-9950-be5eb10256aa None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:55.464478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de687069-03bb-4f4a-ac02-81c772e0f8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:55.465082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de687069-03bb-4f4a-ac02-81c772e0f8c3 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:55.465361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de687069-03bb-4f4a-ac02-81c772e0f8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:55.465622 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de687069-03bb-4f4a-ac02-81c772e0f8c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:55.466294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de687069-03bb-4f4a-ac02-81c772e0f8c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:55.467664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de687069-03bb-4f4a-ac02-81c772e0f8c3 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:55.474023 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01716d-634e-4e6c-a96b-7c7c5f0f419c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:55.489794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 415/818] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 16:12:55 2022] POST /identity/v3/endpoints => generated 337 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:12:55.490485 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de687069-03bb-4f4a-ac02-81c772e0f8c3 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:55.514988 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:55.543433 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6668b-bd05-476b-b738-98f5bd8a19f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:55.545634 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6668b-bd05-476b-b738-98f5bd8a19f3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:55.546201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6668b-bd05-476b-b738-98f5bd8a19f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:55.546662 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6668b-bd05-476b-b738-98f5bd8a19f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:55.562880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6668b-bd05-476b-b738-98f5bd8a19f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:55.565306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6668b-bd05-476b-b738-98f5bd8a19f3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:55.581504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:55.588322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-9bc6668b-bd05-476b-b738-98f5bd8a19f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:55.588322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:55.588322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:55.588322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:55.588322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:55.588322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:55.588322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:55.588322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:55.588322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:55.588322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:55.588322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:55.588322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:55.588322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:55.588322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:55.588322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:55.588322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:55.589341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:55.589341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:55.589341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:55.589341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:55.589341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:55.589341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:55.589341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:55.589341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:55.589341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:55.589341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:55.589341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:55.589341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:55.589341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:55.589341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:55.589341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:55.589341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:55.589341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:55.590255 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:55.590255 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:55.590255 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:55.598403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 404/819] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:55.598403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6668b-bd05-476b-b738-98f5bd8a19f3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:55.639390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de687069-03bb-4f4a-ac02-81c772e0f8c3 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:55.685182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc30eaf-5069-4f0c-a99c-c0d8e5b68f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:55.686837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc30eaf-5069-4f0c-a99c-c0d8e5b68f27 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:55.687133 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc30eaf-5069-4f0c-a99c-c0d8e5b68f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:55.687407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc30eaf-5069-4f0c-a99c-c0d8e5b68f27 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:55.688008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc30eaf-5069-4f0c-a99c-c0d8e5b68f27 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:55.689384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc30eaf-5069-4f0c-a99c-c0d8e5b68f27 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:55.699837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-1fc30eaf-5069-4f0c-a99c-c0d8e5b68f27 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:12:55.699837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:55.699837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:12:55.699837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:12:55.699837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:12:55.699837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:12:55.699837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:12:55.699837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:12:55.699837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:12:55.699837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:55.699837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:12:55.699837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:55.699837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:55.699837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:55.699837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:55.699837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:55.699837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:55.701060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:55.701060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:55.701060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:55.701060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:55.701060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:55.701060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:55.701060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:12:55.701060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:12:55.701060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:12:55.701060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:12:55.701060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:55.701060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:55.701060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:55.701060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:55.701060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:55.701060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:55.702176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:55.702176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:55.702176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:55.702176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:55.702176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:55.702176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:55.702176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:55.702176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:55.702176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:55.702176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:55.702176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:12:55.702176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:12:55.702176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 16:12:55.702176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:55.702176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 416/820] 10.222.0.16 () {56 vars in 1129 bytes} [Tue Aug 23 16:12:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:55.702977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc30eaf-5069-4f0c-a99c-c0d8e5b68f27 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:55.736667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6668b-bd05-476b-b738-98f5bd8a19f3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:55.774050 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b29a8-2493-4b5b-b083-c618189fd207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:55.774930 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b29a8-2493-4b5b-b083-c618189fd207 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:55.775219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b29a8-2493-4b5b-b083-c618189fd207 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:55.775499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b29a8-2493-4b5b-b083-c618189fd207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:55.787537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b29a8-2493-4b5b-b083-c618189fd207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:55.788989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b29a8-2493-4b5b-b083-c618189fd207 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:55.805636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-fd8b29a8-2493-4b5b-b083-c618189fd207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:55.805636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:55.805636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:55.805636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:55.805636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:55.805636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:55.805636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:55.805636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:55.805636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:55.805636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:55.805636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:55.805636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:55.805636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:55.805636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:55.805636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:55.805636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:55.806632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:55.806632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:55.806632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:55.806632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:55.806632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:55.806632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:55.806632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:55.806632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:55.806632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:55.806632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:55.806632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:55.806632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:55.806632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:55.806632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:55.806632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:55.806632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:55.806632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:55.807534 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:55.807534 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:55.807534 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:55.807534 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 405/821] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:55.807534 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b29a8-2493-4b5b-b083-c618189fd207 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:55.829868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc30eaf-5069-4f0c-a99c-c0d8e5b68f27 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:55.834904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:55.865272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:55.874574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40489f36-c43d-4869-a400-586168114545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:55.875194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40489f36-c43d-4869-a400-586168114545 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:55.875446 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40489f36-c43d-4869-a400-586168114545 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:55.875717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40489f36-c43d-4869-a400-586168114545 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:55.876362 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40489f36-c43d-4869-a400-586168114545 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:55.876665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40489f36-c43d-4869-a400-586168114545 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:55.878038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40489f36-c43d-4869-a400-586168114545 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:55.890680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 417/822] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:55.891241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40489f36-c43d-4869-a400-586168114545 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:55.922335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b29a8-2493-4b5b-b083-c618189fd207 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:55.958556 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df8738-dbe9-4f62-a8a4-ab3c37250c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:55.959164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df8738-dbe9-4f62-a8a4-ab3c37250c2c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:55.959450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df8738-dbe9-4f62-a8a4-ab3c37250c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:55.959712 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df8738-dbe9-4f62-a8a4-ab3c37250c2c None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:55.960331 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df8738-dbe9-4f62-a8a4-ab3c37250c2c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:55.960631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df8738-dbe9-4f62-a8a4-ab3c37250c2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:55.962548 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df8738-dbe9-4f62-a8a4-ab3c37250c2c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:55.966957 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 406/823] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 23 16:12:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:55.967722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df8738-dbe9-4f62-a8a4-ab3c37250c2c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:56.010596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40489f36-c43d-4869-a400-586168114545 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:56.045185 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2050a-da98-4f07-bfec-5ac1dcd287b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:56.045784 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2050a-da98-4f07-bfec-5ac1dcd287b0 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:56.046087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2050a-da98-4f07-bfec-5ac1dcd287b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:56.046364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2050a-da98-4f07-bfec-5ac1dcd287b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:56.047000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2050a-da98-4f07-bfec-5ac1dcd287b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:56.047301 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2050a-da98-4f07-bfec-5ac1dcd287b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:56.048662 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2050a-da98-4f07-bfec-5ac1dcd287b0 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:56.065893 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 418/824] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:56.065893 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2050a-da98-4f07-bfec-5ac1dcd287b0 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:56.067680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:56.083357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df8738-dbe9-4f62-a8a4-ab3c37250c2c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:56.120451 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff7a89-c005-4992-87f5-33ee6983229d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:56.121070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff7a89-c005-4992-87f5-33ee6983229d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:56.121359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff7a89-c005-4992-87f5-33ee6983229d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:56.121625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff7a89-c005-4992-87f5-33ee6983229d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:56.125312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:56.128506 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff7a89-c005-4992-87f5-33ee6983229d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:56.130006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff7a89-c005-4992-87f5-33ee6983229d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:56.141927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-f5ff7a89-c005-4992-87f5-33ee6983229d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:56.141927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:56.141927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:56.141927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:56.141927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:56.141927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:56.141927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:56.141927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:56.141927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:56.141927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:56.141927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:56.141927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:56.141927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:56.141927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:56.141927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:56.142854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:56.142854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:56.142854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:56.142854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:56.142854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:56.142854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:56.142854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:56.142854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:56.142854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:56.142854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:56.142854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:56.142854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:56.142854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:56.142854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:56.142854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:56.142854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:56.142854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:56.143769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:56.143769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:56.143769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:56.143769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:56.143769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:56.143769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:56.143769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:56.143769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:56.147681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 407/825] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:56.148380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff7a89-c005-4992-87f5-33ee6983229d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:56.188551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2050a-da98-4f07-bfec-5ac1dcd287b0 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:56.224259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740805dc-2c02-4efb-8605-6343efa1e39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:56.224857 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740805dc-2c02-4efb-8605-6343efa1e39a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:56.225136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740805dc-2c02-4efb-8605-6343efa1e39a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:56.225408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740805dc-2c02-4efb-8605-6343efa1e39a None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:56.226042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740805dc-2c02-4efb-8605-6343efa1e39a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:56.226372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740805dc-2c02-4efb-8605-6343efa1e39a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:56.228022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740805dc-2c02-4efb-8605-6343efa1e39a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:56.233134 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 419/826] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 23 16:12:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:56.233833 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740805dc-2c02-4efb-8605-6343efa1e39a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:56.261918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff7a89-c005-4992-87f5-33ee6983229d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:56.299008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a53df-072c-490c-8996-c86984a77427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:56.299770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a53df-072c-490c-8996-c86984a77427 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:56.300173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a53df-072c-490c-8996-c86984a77427 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:56.300551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a53df-072c-490c-8996-c86984a77427 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:56.308171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a53df-072c-490c-8996-c86984a77427 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:56.309718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a53df-072c-490c-8996-c86984a77427 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:56.321571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-995a53df-072c-490c-8996-c86984a77427 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:56.321571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:56.321571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:56.321571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:56.321571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:56.321571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:56.321571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:56.321571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:56.321571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:56.321571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:56.321571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:56.321571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:56.321571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:12:56.321571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:12:56.321571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:12:56.322710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:12:56.322710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:56.322710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:56.322710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:56.322710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:56.322710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:56.322710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:56.322710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:56.322710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:56.322710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:56.322710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:56.322710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:56.322710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:56.322710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:56.322710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:56.322710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:56.322710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:56.323782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:12:56.323782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:12:56.323782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:12:56.323782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:12:56.323782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:12:56.323782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:12:56.323782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:12:56.323782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:56.324529 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 408/827] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:12:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:56.325364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a53df-072c-490c-8996-c86984a77427 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:56.338993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:56.347791 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740805dc-2c02-4efb-8605-6343efa1e39a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:56.362683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:56.387339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfc5bf-1df9-4c92-a472-6c325b1f6c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:56.387943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfc5bf-1df9-4c92-a472-6c325b1f6c43 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:56.388276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfc5bf-1df9-4c92-a472-6c325b1f6c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:56.388472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfc5bf-1df9-4c92-a472-6c325b1f6c43 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:56.389165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfc5bf-1df9-4c92-a472-6c325b1f6c43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:56.389466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfc5bf-1df9-4c92-a472-6c325b1f6c43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:56.390925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfc5bf-1df9-4c92-a472-6c325b1f6c43 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:56.403566 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 420/828] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:56.404164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfc5bf-1df9-4c92-a472-6c325b1f6c43 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:56.440750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a53df-072c-490c-8996-c86984a77427 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:56.476176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6ebec-58ab-4031-8ee2-117856dc5407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:56.477362 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6ebec-58ab-4031-8ee2-117856dc5407 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:56.477614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6ebec-58ab-4031-8ee2-117856dc5407 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:56.477920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6ebec-58ab-4031-8ee2-117856dc5407 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:56.478614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6ebec-58ab-4031-8ee2-117856dc5407 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:56.479971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6ebec-58ab-4031-8ee2-117856dc5407 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:56.502635 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 409/829] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 16:12:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:12:56.503586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6ebec-58ab-4031-8ee2-117856dc5407 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:56.529099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfc5bf-1df9-4c92-a472-6c325b1f6c43 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:56.591401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76021cbb-e556-4855-878c-4111d105b5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:56.592055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76021cbb-e556-4855-878c-4111d105b5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:56.592687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76021cbb-e556-4855-878c-4111d105b5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:56.593040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76021cbb-e556-4855-878c-4111d105b5a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:56.594447 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:56.594702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76021cbb-e556-4855-878c-4111d105b5a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:56.595564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76021cbb-e556-4855-878c-4111d105b5a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:56.597624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76021cbb-e556-4855-878c-4111d105b5a1 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:56.618143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 421/830] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:12:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:56.625256 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76021cbb-e556-4855-878c-4111d105b5a1 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:56.651396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6ebec-58ab-4031-8ee2-117856dc5407 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:56.669558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:56.698716 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57c899-67cc-4eb6-811f-a7d53145dde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:56.700481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57c899-67cc-4eb6-811f-a7d53145dde5 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:56.700825 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57c899-67cc-4eb6-811f-a7d53145dde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:56.701177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57c899-67cc-4eb6-811f-a7d53145dde5 None admin] PATH_INFO: `/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/5fe3a02c2bc247efa354ca5bac39ec4e/roles/bbf63b75406649a3b653308ecb75062d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:56.717796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57c899-67cc-4eb6-811f-a7d53145dde5 None admin] RBAC: Authorizing `identity:create_grant(project_id=15a0439c9dd3406f81e2740fe775782b, user_id=5fe3a02c2bc247efa354ca5bac39ec4e, role_id=bbf63b75406649a3b653308ecb75062d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:56.719280 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57c899-67cc-4eb6-811f-a7d53145dde5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:56.734994 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 410/831] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:12:56 2022] PUT /identity/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/5fe3a02c2bc247efa354ca5bac39ec4e/roles/bbf63b75406649a3b653308ecb75062d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:12:56.759483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76021cbb-e556-4855-878c-4111d105b5a1 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:56.803140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79130d3-382f-4a7b-a43c-df3f889e8f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:56.803812 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79130d3-382f-4a7b-a43c-df3f889e8f8b None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:56.804092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79130d3-382f-4a7b-a43c-df3f889e8f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:56.804369 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79130d3-382f-4a7b-a43c-df3f889e8f8b None admin] PATH_INFO: `/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/e7fb290911bc4de887d04b71731f76b5/roles/8de0c87242d7426ea25a510b578c02aa` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:56.806689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79130d3-382f-4a7b-a43c-df3f889e8f8b None admin] RBAC: Authorizing `identity:create_grant(project_id=15a0439c9dd3406f81e2740fe775782b, user_id=e7fb290911bc4de887d04b71731f76b5, role_id=8de0c87242d7426ea25a510b578c02aa)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:56.808161 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79130d3-382f-4a7b-a43c-df3f889e8f8b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:56.834196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 422/832] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:12:56 2022] PUT /identity/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/e7fb290911bc4de887d04b71731f76b5/roles/8de0c87242d7426ea25a510b578c02aa => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:12:56.945699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd8449-2759-4c43-a3c1-9fe35a0b2336 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:56.945878 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd8449-2759-4c43-a3c1-9fe35a0b2336 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:56.946108 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd8449-2759-4c43-a3c1-9fe35a0b2336 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:56.947866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 411/833] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:56.953596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbbfc7-b673-4b33-9730-5887598cc4d8 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:56.953880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbbfc7-b673-4b33-9730-5887598cc4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:56.954179 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbbfc7-b673-4b33-9730-5887598cc4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:56.975805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-b6cbbfc7-b673-4b33-9730-5887598cc4d8 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:56.977995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b6cbbfc7-b673-4b33-9730-5887598cc4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:57.052032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 423/834] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:12:57.322973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd8449-2759-4c43-a3c1-9fe35a0b2336 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:57.434625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd8449-2759-4c43-a3c1-9fe35a0b2336 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:57.449856 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:57.471793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0697f-e55e-42c3-a0fa-a7d00f52924f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:57.472705 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0697f-e55e-42c3-a0fa-a7d00f52924f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:57.473179 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0697f-e55e-42c3-a0fa-a7d00f52924f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:57.473644 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0697f-e55e-42c3-a0fa-a7d00f52924f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:57.474491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0697f-e55e-42c3-a0fa-a7d00f52924f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:57.476116 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0697f-e55e-42c3-a0fa-a7d00f52924f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:57.485985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-17a0697f-e55e-42c3-a0fa-a7d00f52924f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:12:57.485985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:57.485985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:12:57.485985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:12:57.485985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:12:57.485985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:12:57.485985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:12:57.485985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:12:57.485985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:12:57.485985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:57.485985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:12:57.485985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:57.485985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:57.485985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:57.485985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:57.485985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:57.487384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:57.487384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:57.487384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:57.487384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:57.487384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:57.487384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:57.487384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:57.487384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:12:57.487384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:12:57.487384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:12:57.487384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:12:57.487384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:57.487384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:57.487384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:57.487384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:57.487384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:57.487384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:57.488263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:57.488263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:57.488263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:57.488263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:57.488263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:57.488263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:57.488263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:57.488263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:57.488263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:57.488263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:57.488263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:12:57.488263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:12:57.488263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:12:57.488263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:57.490987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 412/835] 10.222.0.16 () {56 vars in 1132 bytes} [Tue Aug 23 16:12:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:57.502108 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbbfc7-b673-4b33-9730-5887598cc4d8 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:57.521614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:57.603013 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbbfc7-b673-4b33-9730-5887598cc4d8 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:57.638694 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad69df-7cb3-4f18-b5d9-b35a7a265cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:57.639302 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad69df-7cb3-4f18-b5d9-b35a7a265cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:57.639586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad69df-7cb3-4f18-b5d9-b35a7a265cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:57.639925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad69df-7cb3-4f18-b5d9-b35a7a265cd7 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:57.640568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad69df-7cb3-4f18-b5d9-b35a7a265cd7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:57.640874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad69df-7cb3-4f18-b5d9-b35a7a265cd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:57.642272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad69df-7cb3-4f18-b5d9-b35a7a265cd7 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:57.647356 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 424/836] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 16:12:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:57.653589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0697f-e55e-42c3-a0fa-a7d00f52924f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:57.761752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0697f-e55e-42c3-a0fa-a7d00f52924f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:57.796203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f00c2-aac5-4382-8d8d-688e9911837d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:57.796807 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f00c2-aac5-4382-8d8d-688e9911837d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:57.797083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f00c2-aac5-4382-8d8d-688e9911837d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:57.797356 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f00c2-aac5-4382-8d8d-688e9911837d None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:57.797983 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f00c2-aac5-4382-8d8d-688e9911837d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:57.798308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f00c2-aac5-4382-8d8d-688e9911837d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:57.799646 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f00c2-aac5-4382-8d8d-688e9911837d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:57.804436 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 413/837] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 16:12:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:58.584879 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42d7d7-0c36-42ae-8ba5-7d95eb55581d None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:58.585309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42d7d7-0c36-42ae-8ba5-7d95eb55581d None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:58.585437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42d7d7-0c36-42ae-8ba5-7d95eb55581d None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:58.587494 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 425/838] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:58.592812 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b47df4-704c-439d-bbe5-36393df88a7d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:58.593256 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b47df4-704c-439d-bbe5-36393df88a7d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:58.593422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b47df4-704c-439d-bbe5-36393df88a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:58.612482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-37b47df4-704c-439d-bbe5-36393df88a7d None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:58.613684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-37b47df4-704c-439d-bbe5-36393df88a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:58.654397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:58.687347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 414/839] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:12:58.786160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36998a98-f976-4e8a-b94b-94d9744281b6 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:58.786708 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36998a98-f976-4e8a-b94b-94d9744281b6 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:58.786708 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36998a98-f976-4e8a-b94b-94d9744281b6 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:58.788262 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 426/840] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:58.794199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158a3fd-cd3d-4e4a-998b-e50c4298301e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:58.794486 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158a3fd-cd3d-4e4a-998b-e50c4298301e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:58.794757 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158a3fd-cd3d-4e4a-998b-e50c4298301e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:58.813215 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7158a3fd-cd3d-4e4a-998b-e50c4298301e None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:58.814429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7158a3fd-cd3d-4e4a-998b-e50c4298301e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:58.820275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b1591-6711-461d-a669-a5941e887f93 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:58.821123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b1591-6711-461d-a669-a5941e887f93 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:58.821375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b1591-6711-461d-a669-a5941e887f93 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:58.823022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 427/841] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:58.828261 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccefa2f-227e-423b-a806-6301f22039b9 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:58.828783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccefa2f-227e-423b-a806-6301f22039b9 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:58.829256 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccefa2f-227e-423b-a806-6301f22039b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:58.848764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-2ccefa2f-227e-423b-a806-6301f22039b9 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:58.850314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-2ccefa2f-227e-423b-a806-6301f22039b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:58.894090 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 415/842] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:12:58.927700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 428/843] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:12:58.981459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158a3fd-cd3d-4e4a-998b-e50c4298301e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:59.081819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158a3fd-cd3d-4e4a-998b-e50c4298301e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:59.083356 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:59.116065 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe17c08-5a35-433b-8217-89a74b7a3073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:59.116625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe17c08-5a35-433b-8217-89a74b7a3073 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:59.116901 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe17c08-5a35-433b-8217-89a74b7a3073 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:59.117171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe17c08-5a35-433b-8217-89a74b7a3073 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:59.118428 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe17c08-5a35-433b-8217-89a74b7a3073 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:59.119779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe17c08-5a35-433b-8217-89a74b7a3073 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:59.128341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2fe17c08-5a35-433b-8217-89a74b7a3073 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:12:59.128341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:59.128341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:12:59.128341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:12:59.128341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:12:59.128341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:12:59.128341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:12:59.128341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:12:59.128341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:12:59.128341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:59.128341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:12:59.128341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:59.128341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:59.128341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:59.128341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:59.128341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:59.128341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:59.129312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:59.129312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:59.129312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:59.129312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:59.129312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:59.129312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:59.129312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:12:59.129312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:12:59.129312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:12:59.129312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:12:59.129312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:59.129312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:59.129312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:59.129312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:59.129312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:59.129312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:59.130480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:59.130480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:59.130480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:59.130480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:59.130480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:59.130480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:59.130480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:59.130480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:59.130480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:59.130480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:59.130480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:12:59.130480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:12:59.130480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:12:59.130480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:59.130480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 416/844] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:12:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:59.138355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccefa2f-227e-423b-a806-6301f22039b9 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:59.172979 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe17c08-5a35-433b-8217-89a74b7a3073 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:59.174252 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:59.263157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccefa2f-227e-423b-a806-6301f22039b9 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:59.302831 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863de76b-9cef-4d98-bced-46fb1fae0b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:59.303454 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863de76b-9cef-4d98-bced-46fb1fae0b84 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:59.303733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863de76b-9cef-4d98-bced-46fb1fae0b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:59.304000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863de76b-9cef-4d98-bced-46fb1fae0b84 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:59.304649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863de76b-9cef-4d98-bced-46fb1fae0b84 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:59.305124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863de76b-9cef-4d98-bced-46fb1fae0b84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:59.306582 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863de76b-9cef-4d98-bced-46fb1fae0b84 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:59.316557 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 429/845] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:12:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:59.316557 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863de76b-9cef-4d98-bced-46fb1fae0b84 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:59.399688 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:59.399932 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe17c08-5a35-433b-8217-89a74b7a3073 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:59.426155 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863de76b-9cef-4d98-bced-46fb1fae0b84 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:59.437415 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5c996-ce20-40e7-a625-bffc30ec6312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:59.438346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5c996-ce20-40e7-a625-bffc30ec6312 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:59.438807 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5c996-ce20-40e7-a625-bffc30ec6312 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:59.439256 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5c996-ce20-40e7-a625-bffc30ec6312 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:59.450514 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5c996-ce20-40e7-a625-bffc30ec6312 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:59.455309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-69e5c996-ce20-40e7-a625-bffc30ec6312 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:59.455309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:59.455309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:59.455309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:59.455309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:59.455309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:59.455309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:59.455309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:59.455309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:59.455309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:59.455309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:59.455309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:59.455309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:59.455309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:59.455309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:59.455309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:59.456418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:59.456418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:59.456418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:59.456418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:59.456418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:59.456418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:59.456418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:59.456418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:59.456418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:59.456418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:59.456418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:59.456418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:59.456418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:59.456418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:59.456418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:59.456418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:59.457444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:59.457444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:59.457444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:59.457444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:59.457444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:59.457444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:59.457444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:59.457444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:59.457444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:59.457444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:59.457444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:12:59.457444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:12:59.459568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 417/846] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:12:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:12:59.460964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5c996-ce20-40e7-a625-bffc30ec6312 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:59.465941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4edab-cb45-4593-a142-c867ea497625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:59.466604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4edab-cb45-4593-a142-c867ea497625 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:59.466883 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4edab-cb45-4593-a142-c867ea497625 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:59.467259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4edab-cb45-4593-a142-c867ea497625 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:59.479227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4edab-cb45-4593-a142-c867ea497625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:12:59.483845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-54b4edab-cb45-4593-a142-c867ea497625 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:12:59.483845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:59.483845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:59.483845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:59.483845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:59.483845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:59.483845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:59.483845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:59.483845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:59.483845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:59.483845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:59.483845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:59.483845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:12:59.483845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:12:59.483845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:12:59.483845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:12:59.484771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:12:59.484771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:12:59.484771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:12:59.484771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:12:59.484771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:59.484771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:59.484771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:59.484771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:59.484771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:59.484771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:59.484771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:59.484771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:59.484771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:59.484771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:59.484771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:59.484771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:59.485609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:59.485609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:59.485609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:59.485609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:59.485609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:12:59.485609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:12:59.485609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:12:59.485609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:12:59.485609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:12:59.485609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:12:59.485609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:12:59.485609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:59.485609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 430/847] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:12:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:12:59.486335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4edab-cb45-4593-a142-c867ea497625 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:59.496614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:59.571941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5c996-ce20-40e7-a625-bffc30ec6312 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:59.594090 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4edab-cb45-4593-a142-c867ea497625 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:59.610693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43370ba6-5683-414a-b288-73aac537410c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:59.611965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43370ba6-5683-414a-b288-73aac537410c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:59.612647 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43370ba6-5683-414a-b288-73aac537410c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:59.613096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43370ba6-5683-414a-b288-73aac537410c None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:59.613884 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43370ba6-5683-414a-b288-73aac537410c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:59.614353 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43370ba6-5683-414a-b288-73aac537410c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:59.616598 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43370ba6-5683-414a-b288-73aac537410c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:59.622872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 418/848] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:12:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:59.624273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43370ba6-5683-414a-b288-73aac537410c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:59.637768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2707c-a7c2-4088-9026-36a9cbe3a3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:59.638596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2707c-a7c2-4088-9026-36a9cbe3a3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:59.638940 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2707c-a7c2-4088-9026-36a9cbe3a3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:59.639278 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2707c-a7c2-4088-9026-36a9cbe3a3e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:59.640036 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2707c-a7c2-4088-9026-36a9cbe3a3e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:59.640407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2707c-a7c2-4088-9026-36a9cbe3a3e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:59.641919 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2707c-a7c2-4088-9026-36a9cbe3a3e9 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:59.648301 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:59.653354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 431/849] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:12:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:59.665067 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2707c-a7c2-4088-9026-36a9cbe3a3e9 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:59.758251 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:59.771453 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43370ba6-5683-414a-b288-73aac537410c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:59.801439 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2707c-a7c2-4088-9026-36a9cbe3a3e9 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:59.811739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0fdbe-f7de-4777-ac67-a0b16f75e24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:59.812385 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0fdbe-f7de-4777-ac67-a0b16f75e24f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:59.812668 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0fdbe-f7de-4777-ac67-a0b16f75e24f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:59.812945 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0fdbe-f7de-4777-ac67-a0b16f75e24f None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:59.813993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0fdbe-f7de-4777-ac67-a0b16f75e24f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:12:59.814366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0fdbe-f7de-4777-ac67-a0b16f75e24f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:59.816052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0fdbe-f7de-4777-ac67-a0b16f75e24f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:59.825099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 419/850] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:12:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:12:59.830102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca110cdb-7a5a-4c28-806d-7479c7b0f4f9 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:59.830102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca110cdb-7a5a-4c28-806d-7479c7b0f4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:59.830102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca110cdb-7a5a-4c28-806d-7479c7b0f4f9 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:59.830102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 420/851] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:12:59.832875 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca110cdb-7a5a-4c28-806d-7479c7b0f4f9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:12:59.846085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e5907-0234-447e-a70f-4d08c70e5c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:12:59.846746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e5907-0234-447e-a70f-4d08c70e5c7d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:59.847024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e5907-0234-447e-a70f-4d08c70e5c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:59.847304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e5907-0234-447e-a70f-4d08c70e5c7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:59.859102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e5907-0234-447e-a70f-4d08c70e5c7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:12:59.861007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e5907-0234-447e-a70f-4d08c70e5c7d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:12:59.877495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-dd0e5907-0234-447e-a70f-4d08c70e5c7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:59.877495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:12:59.877495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:12:59.877495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:12:59.877495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:12:59.877495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:12:59.877495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:12:59.877495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:12:59.877495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:12:59.877495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:12:59.877495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:12:59.877495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:12:59.877495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:12:59.877495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:12:59.877495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:12:59.877495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:12:59.878563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:12:59.878563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:12:59.878563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:12:59.878563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:12:59.878563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:12:59.878563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:12:59.878563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:12:59.878563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:12:59.878563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:12:59.878563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:12:59.878563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:12:59.878563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:12:59.878563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:12:59.878563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:12:59.878563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:12:59.878563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:12:59.878563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:12:59.879469 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:12:59.879469 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:12:59.879469 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:12:59.879653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 432/852] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:12:59.880844 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1a988-f11a-4891-9819-d29b34b1db83 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:12:59.881150 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1a988-f11a-4891-9819-d29b34b1db83 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:12:59.881424 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1a988-f11a-4891-9819-d29b34b1db83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:12:59.900128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-3ac1a988-f11a-4891-9819-d29b34b1db83 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:12:59.901755 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-3ac1a988-f11a-4891-9819-d29b34b1db83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:12:59.951684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca110cdb-7a5a-4c28-806d-7479c7b0f4f9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:12:59.955275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:12:59.981426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 433/853] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:12:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:12:59.982679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1a988-f11a-4891-9819-d29b34b1db83 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:00.001166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7c1f0-c599-4795-8122-175125489019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:00.002357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7c1f0-c599-4795-8122-175125489019 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:00.002827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7c1f0-c599-4795-8122-175125489019 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:00.003305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7c1f0-c599-4795-8122-175125489019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:00.017674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7c1f0-c599-4795-8122-175125489019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:00.020197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7c1f0-c599-4795-8122-175125489019 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:00.040361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5ee7c1f0-c599-4795-8122-175125489019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:00.040361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:00.040361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:00.040361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:00.040361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:00.040361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:00.040361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:00.040361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:00.040361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:00.040361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:00.040361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:00.040361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:00.040361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:00.040361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:00.040361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:00.040361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:00.041490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:00.041490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:00.041490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:00.041490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:00.041490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:00.041490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:00.041490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:00.041490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:00.041490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:00.041490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:00.041490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:00.041490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:00.041490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:00.041490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:00.041490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:00.041490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:00.041490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:00.042511 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:00.042511 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:00.042511 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:00.046122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 421/854] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:00.049041 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7c1f0-c599-4795-8122-175125489019 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:00.053932 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:00.109639 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1a988-f11a-4891-9819-d29b34b1db83 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:00.157682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2783efb-4fc6-44bf-b606-a730eaf951cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:00.158771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2783efb-4fc6-44bf-b606-a730eaf951cf None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:00.159158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2783efb-4fc6-44bf-b606-a730eaf951cf None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:00.159766 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2783efb-4fc6-44bf-b606-a730eaf951cf None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:00.160498 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2783efb-4fc6-44bf-b606-a730eaf951cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:00.160874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2783efb-4fc6-44bf-b606-a730eaf951cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:00.162364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2783efb-4fc6-44bf-b606-a730eaf951cf None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:00.165065 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7c1f0-c599-4795-8122-175125489019 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:00.182996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 434/855] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:00.184542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2783efb-4fc6-44bf-b606-a730eaf951cf None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:00.210770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248f0c6-5a83-4683-a5b0-3495fd4b46ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:00.211361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248f0c6-5a83-4683-a5b0-3495fd4b46ac None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:00.211660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248f0c6-5a83-4683-a5b0-3495fd4b46ac None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:00.211919 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248f0c6-5a83-4683-a5b0-3495fd4b46ac None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:00.212728 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248f0c6-5a83-4683-a5b0-3495fd4b46ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:00.213040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248f0c6-5a83-4683-a5b0-3495fd4b46ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:00.215026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248f0c6-5a83-4683-a5b0-3495fd4b46ac None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:00.230457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 422/856] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:00.239204 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248f0c6-5a83-4683-a5b0-3495fd4b46ac None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:00.240863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:00.311009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2783efb-4fc6-44bf-b606-a730eaf951cf None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:00.315807 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:00.346659 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266ac4c-335b-4aea-98f7-b9fbd54dbe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:00.347279 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266ac4c-335b-4aea-98f7-b9fbd54dbe18 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:00.347567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266ac4c-335b-4aea-98f7-b9fbd54dbe18 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:00.347843 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266ac4c-335b-4aea-98f7-b9fbd54dbe18 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:00.356308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266ac4c-335b-4aea-98f7-b9fbd54dbe18 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:00.356664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248f0c6-5a83-4683-a5b0-3495fd4b46ac None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:00.357741 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266ac4c-335b-4aea-98f7-b9fbd54dbe18 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:00.370521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-f266ac4c-335b-4aea-98f7-b9fbd54dbe18 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:13:00.370521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:00.370521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:00.370521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:00.370521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:00.370521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:00.370521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:00.370521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:00.370521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:00.370521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:00.370521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:00.370521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:00.370521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:13:00.370521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:13:00.370521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:13:00.370521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:13:00.371483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:00.371483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:00.371483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:13:00.371483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:00.371483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:13:00.371483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:00.371483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:00.371483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:00.371483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:00.371483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:00.371483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:00.371483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:00.371483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:00.371483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:00.371483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:00.371483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:00.371483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:00.371483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:00.372397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:00.372397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:00.372397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:13:00.372397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:13:00.372397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:13:00.372397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:13:00.372397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:13:00.372397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:13:00.372397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:13:00.372397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:00.372397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 435/857] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 23 16:13:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:00.372397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266ac4c-335b-4aea-98f7-b9fbd54dbe18 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:00.397700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb661a6c-117e-4fa8-be98-e69ddd538cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:00.398678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb661a6c-117e-4fa8-be98-e69ddd538cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:00.399373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb661a6c-117e-4fa8-be98-e69ddd538cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:00.399936 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb661a6c-117e-4fa8-be98-e69ddd538cc4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:00.407267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb661a6c-117e-4fa8-be98-e69ddd538cc4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:00.408975 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb661a6c-117e-4fa8-be98-e69ddd538cc4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:00.420839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-bb661a6c-117e-4fa8-be98-e69ddd538cc4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:13:00.420839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:00.420839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:00.420839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:00.420839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:00.420839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:00.420839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:00.420839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:00.420839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:00.420839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:00.420839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:00.420839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:00.420839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:13:00.420839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:13:00.420839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:13:00.420839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:13:00.421971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:00.421971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:00.421971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:13:00.421971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:00.421971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:13:00.421971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:00.421971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:00.421971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:00.421971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:00.421971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:00.421971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:00.421971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:00.421971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:00.421971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:00.421971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:00.421971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:00.421971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:00.421971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:00.423373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:00.423373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:00.423373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:13:00.423373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:13:00.423373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:13:00.423373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:13:00.423373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:13:00.423373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:13:00.423373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 16:13:00.423373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:00.426482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 423/858] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:13:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:00.427312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb661a6c-117e-4fa8-be98-e69ddd538cc4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:00.484286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:00.488696 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266ac4c-335b-4aea-98f7-b9fbd54dbe18 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:00.524537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb608a2-3944-4fa2-b1b5-561c5b5113e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:00.525270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb608a2-3944-4fa2-b1b5-561c5b5113e7 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:00.525551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb608a2-3944-4fa2-b1b5-561c5b5113e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:00.525822 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb608a2-3944-4fa2-b1b5-561c5b5113e7 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:00.526497 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb608a2-3944-4fa2-b1b5-561c5b5113e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:00.527855 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb608a2-3944-4fa2-b1b5-561c5b5113e7 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:00.531807 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb661a6c-117e-4fa8-be98-e69ddd538cc4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:00.544264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 436/859] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 16:13:00 2022] POST /identity/v3/services => generated 269 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:13:00.544962 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb608a2-3944-4fa2-b1b5-561c5b5113e7 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:00.577371 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:00.603298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0138e-0205-4e7c-9801-a9f93051d8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:00.604006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0138e-0205-4e7c-9801-a9f93051d8fb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:00.604290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0138e-0205-4e7c-9801-a9f93051d8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:00.604562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0138e-0205-4e7c-9801-a9f93051d8fb None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:00.605324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0138e-0205-4e7c-9801-a9f93051d8fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:00.605630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0138e-0205-4e7c-9801-a9f93051d8fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:00.607272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0138e-0205-4e7c-9801-a9f93051d8fb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:00.634797 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 424/860] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 23 16:13:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:00.637275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0138e-0205-4e7c-9801-a9f93051d8fb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:00.700856 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb608a2-3944-4fa2-b1b5-561c5b5113e7 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:00.744629 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40ac36-2442-49e0-a084-ad2ba315287a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:00.745169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40ac36-2442-49e0-a084-ad2ba315287a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:00.745452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40ac36-2442-49e0-a084-ad2ba315287a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:00.745729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40ac36-2442-49e0-a084-ad2ba315287a None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:00.746471 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40ac36-2442-49e0-a084-ad2ba315287a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:00.746834 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40ac36-2442-49e0-a084-ad2ba315287a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:00.748288 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40ac36-2442-49e0-a084-ad2ba315287a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:00.770561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 437/861] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 23 16:13:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:00.771463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0138e-0205-4e7c-9801-a9f93051d8fb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:00.777982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40ac36-2442-49e0-a084-ad2ba315287a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:00.806604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:00.818948 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709a1f9-2aea-46bc-8e91-7c2600fe59c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:00.819689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709a1f9-2aea-46bc-8e91-7c2600fe59c8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:00.820067 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709a1f9-2aea-46bc-8e91-7c2600fe59c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:00.820935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709a1f9-2aea-46bc-8e91-7c2600fe59c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:00.878824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:00.909113 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709a1f9-2aea-46bc-8e91-7c2600fe59c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:00.911369 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709a1f9-2aea-46bc-8e91-7c2600fe59c8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:00.919942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40ac36-2442-49e0-a084-ad2ba315287a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:00.965237 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3d39d-971a-4c76-bbdb-24f58ef2ecbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:00.966123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3d39d-971a-4c76-bbdb-24f58ef2ecbc None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:00.966553 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3d39d-971a-4c76-bbdb-24f58ef2ecbc None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:00.967104 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3d39d-971a-4c76-bbdb-24f58ef2ecbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:01.041500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 425/862] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:13:00 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 16:13:01.049271 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709a1f9-2aea-46bc-8e91-7c2600fe59c8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:01.051121 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3d39d-971a-4c76-bbdb-24f58ef2ecbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:01.053458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3d39d-971a-4c76-bbdb-24f58ef2ecbc None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:01.075147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:01.158241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:01.182230 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 438/863] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:13:00 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:13:01.184796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3d39d-971a-4c76-bbdb-24f58ef2ecbc None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:01.195048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709a1f9-2aea-46bc-8e91-7c2600fe59c8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:01.244141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cd25a-e417-410b-8068-97aee5d9e044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:01.245268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cd25a-e417-410b-8068-97aee5d9e044 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:01.245727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cd25a-e417-410b-8068-97aee5d9e044 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:01.246322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cd25a-e417-410b-8068-97aee5d9e044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:01.261289 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cd25a-e417-410b-8068-97aee5d9e044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:01.263808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cd25a-e417-410b-8068-97aee5d9e044 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:01.282926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-820cd25a-e417-410b-8068-97aee5d9e044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:01.282926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:01.282926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:01.282926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:01.282926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:01.282926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:01.282926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:01.282926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:01.282926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:01.282926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:01.282926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:01.282926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:01.282926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:01.282926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:01.282926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:01.282926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:01.284487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:01.284487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:01.284487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:01.284487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:01.284487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:01.284487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:01.284487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:01.284487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:01.284487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:01.284487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:01.284487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:01.284487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:01.284487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:01.284487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:01.284487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:01.284487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:01.284487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:01.285606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:01.285606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:01.285606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:01.287883 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 426/864] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:01.293431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cd25a-e417-410b-8068-97aee5d9e044 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:01.301823 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3d39d-971a-4c76-bbdb-24f58ef2ecbc None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:01.321213 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:01.340722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0ec3e-52ce-4946-8429-6e122b2da98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:01.341290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0ec3e-52ce-4946-8429-6e122b2da98e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:01.341571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0ec3e-52ce-4946-8429-6e122b2da98e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:01.341840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0ec3e-52ce-4946-8429-6e122b2da98e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:01.353551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0ec3e-52ce-4946-8429-6e122b2da98e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:01.355041 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0ec3e-52ce-4946-8429-6e122b2da98e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:01.370866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-05b0ec3e-52ce-4946-8429-6e122b2da98e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:01.370866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:01.370866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:01.370866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:01.370866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:01.370866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:01.370866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:01.370866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:01.370866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:01.370866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:01.370866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:01.370866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:01.370866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:01.370866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:01.370866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:01.370866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:01.371836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:01.371836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:01.371836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:01.371836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:01.371836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:01.371836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:01.371836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:01.371836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:01.371836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:01.371836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:01.371836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:01.371836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:01.371836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:01.371836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:01.371836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:01.371836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:01.371836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:01.372762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:01.372762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:01.372762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:01.376484 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 439/865] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:01.377728 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0ec3e-52ce-4946-8429-6e122b2da98e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:01.424949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cd25a-e417-410b-8068-97aee5d9e044 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:01.465096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:01.473834 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cd928-30e1-4be5-86a9-c72791c96e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:01.475148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cd928-30e1-4be5-86a9-c72791c96e48 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:01.475612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cd928-30e1-4be5-86a9-c72791c96e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:01.476281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cd928-30e1-4be5-86a9-c72791c96e48 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:01.477758 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0cd928-30e1-4be5-86a9-c72791c96e48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:01.478478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0cd928-30e1-4be5-86a9-c72791c96e48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:01.480505 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0cd928-30e1-4be5-86a9-c72791c96e48 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:01.496282 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0ec3e-52ce-4946-8429-6e122b2da98e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:01.497652 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 427/866] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:01.504447 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cd928-30e1-4be5-86a9-c72791c96e48 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:01.541548 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf9cd5-92c7-4084-b004-920297519c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:01.542295 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf9cd5-92c7-4084-b004-920297519c3e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:01.542655 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf9cd5-92c7-4084-b004-920297519c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:01.543029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf9cd5-92c7-4084-b004-920297519c3e None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:01.543804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf9cd5-92c7-4084-b004-920297519c3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:01.544125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf9cd5-92c7-4084-b004-920297519c3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:01.545892 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cf9cd5-92c7-4084-b004-920297519c3e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:01.564796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 440/867] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:01.566177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf9cd5-92c7-4084-b004-920297519c3e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:01.602331 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:01.626800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cd928-30e1-4be5-86a9-c72791c96e48 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:01.663931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd35dcab-7b68-4ef6-bb49-344d1e983ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:01.665241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35dcab-7b68-4ef6-bb49-344d1e983ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:01.665476 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35dcab-7b68-4ef6-bb49-344d1e983ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:01.665756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd35dcab-7b68-4ef6-bb49-344d1e983ed8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:01.672965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35dcab-7b68-4ef6-bb49-344d1e983ed8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:01.674569 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd35dcab-7b68-4ef6-bb49-344d1e983ed8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:01.677532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf9cd5-92c7-4084-b004-920297519c3e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:01.686235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-dd35dcab-7b68-4ef6-bb49-344d1e983ed8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:01.686235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:01.686235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:01.686235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:01.686235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:01.686235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:01.686235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:01.686235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:01.686235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:01.686235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:01.686235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:01.686235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:01.686235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:13:01.686235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:13:01.686235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:13:01.687141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:13:01.687141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:01.687141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:01.687141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:01.687141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:01.687141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:01.687141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:01.687141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:01.687141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:01.687141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:01.687141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:01.687141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:01.687141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:01.687141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:01.687141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:01.687141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:01.687141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:01.688040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:13:01.688040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:13:01.688040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:13:01.688040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:13:01.688040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:13:01.688040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:13:01.688040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:01.688040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:01.688040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 428/868] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:13:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:01.689092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbe08f-5e04-4ab7-9815-60f209eaf6db None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:01.689092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbe08f-5e04-4ab7-9815-60f209eaf6db None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:01.689247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbe08f-5e04-4ab7-9815-60f209eaf6db None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:01.691356 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 429/869] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:01.698260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbe08f-5e04-4ab7-9815-60f209eaf6db None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:01.722718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd020a-ac98-481d-bb11-bb5742d596c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:01.723798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd020a-ac98-481d-bb11-bb5742d596c6 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:01.724085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd020a-ac98-481d-bb11-bb5742d596c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:01.724625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd020a-ac98-481d-bb11-bb5742d596c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:01.732868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd020a-ac98-481d-bb11-bb5742d596c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:01.734403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd020a-ac98-481d-bb11-bb5742d596c6 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:01.746888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-c2cd020a-ac98-481d-bb11-bb5742d596c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:01.746888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:01.746888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:01.746888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:01.746888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:01.746888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:01.746888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:01.746888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:01.746888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:01.746888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:01.746888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:01.746888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:01.746888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:13:01.746888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:13:01.746888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:13:01.747841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:13:01.747841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:01.747841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:01.747841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:01.747841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:01.747841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:01.747841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:01.747841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:01.747841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:01.747841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:01.747841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:01.747841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:01.747841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:01.747841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:01.747841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:01.747841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:01.747841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:01.748733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:13:01.748733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:13:01.748733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:13:01.748733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:13:01.748733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:13:01.748733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:13:01.748733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:01.748733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:01.748733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 441/870] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:13:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:01.750323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae173e-fb21-493e-aad9-328b1d2eca38 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:01.750323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae173e-fb21-493e-aad9-328b1d2eca38 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:01.750323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae173e-fb21-493e-aad9-328b1d2eca38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:01.757138 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:01.767499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-dbae173e-fb21-493e-aad9-328b1d2eca38 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:01.768689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-dbae173e-fb21-493e-aad9-328b1d2eca38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:01.812555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbe08f-5e04-4ab7-9815-60f209eaf6db None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:01.842299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 442/871] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:01 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:01.843143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae173e-fb21-493e-aad9-328b1d2eca38 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:01.864186 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699026bc-aef7-4e49-925c-df26cef9d87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:01.865079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:01.866724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699026bc-aef7-4e49-925c-df26cef9d87e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:01.868231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699026bc-aef7-4e49-925c-df26cef9d87e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:01.868729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699026bc-aef7-4e49-925c-df26cef9d87e None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:01.870446 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699026bc-aef7-4e49-925c-df26cef9d87e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:01.871401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699026bc-aef7-4e49-925c-df26cef9d87e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:01.873559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699026bc-aef7-4e49-925c-df26cef9d87e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:01.895022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 430/872] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:13:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:01.897147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699026bc-aef7-4e49-925c-df26cef9d87e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:01.975712 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae173e-fb21-493e-aad9-328b1d2eca38 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:02.014834 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573ac4-be5a-4207-b533-f62b29627b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:02.015444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573ac4-be5a-4207-b533-f62b29627b80 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:02.015727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573ac4-be5a-4207-b533-f62b29627b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:02.016001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573ac4-be5a-4207-b533-f62b29627b80 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:02.016695 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72573ac4-be5a-4207-b533-f62b29627b80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:02.017002 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72573ac4-be5a-4207-b533-f62b29627b80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:02.018487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72573ac4-be5a-4207-b533-f62b29627b80 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:02.031707 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 443/873] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:13:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:02.037198 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573ac4-be5a-4207-b533-f62b29627b80 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:02.048253 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699026bc-aef7-4e49-925c-df26cef9d87e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:02.059964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:02.085071 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87efa7c-ccc2-479b-9e5d-cb0d26d42808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:02.085745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87efa7c-ccc2-479b-9e5d-cb0d26d42808 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:02.086692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87efa7c-ccc2-479b-9e5d-cb0d26d42808 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:02.087456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87efa7c-ccc2-479b-9e5d-cb0d26d42808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:02.088137 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87efa7c-ccc2-479b-9e5d-cb0d26d42808 None admin] RBAC: Adding query filter params (role.id=bbf63b75406649a3b653308ecb75062d, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=5fe3a02c2bc247efa354ca5bac39ec4e) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:02.088548 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87efa7c-ccc2-479b-9e5d-cb0d26d42808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:02.090102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87efa7c-ccc2-479b-9e5d-cb0d26d42808 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:02.102808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 431/874] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:13:01 2022] GET /identity/v3/role_assignments?user.id=5fe3a02c2bc247efa354ca5bac39ec4e&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=bbf63b75406649a3b653308ecb75062d => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:02.124821 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87efa7c-ccc2-479b-9e5d-cb0d26d42808 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:02.137500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:02.165022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573ac4-be5a-4207-b533-f62b29627b80 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:02.215456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d17c6-95ef-4bef-b38c-6e0c93a8cae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:02.216482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d17c6-95ef-4bef-b38c-6e0c93a8cae0 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:02.216970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d17c6-95ef-4bef-b38c-6e0c93a8cae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:02.217427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d17c6-95ef-4bef-b38c-6e0c93a8cae0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:02.218427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d17c6-95ef-4bef-b38c-6e0c93a8cae0 None admin] RBAC: Adding query filter params (role.id=8de0c87242d7426ea25a510b578c02aa, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=e7fb290911bc4de887d04b71731f76b5) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:02.218741 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d17c6-95ef-4bef-b38c-6e0c93a8cae0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:02.220206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d17c6-95ef-4bef-b38c-6e0c93a8cae0 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:02.227182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 444/875] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:13:02 2022] GET /identity/v3/role_assignments?user.id=e7fb290911bc4de887d04b71731f76b5&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=8de0c87242d7426ea25a510b578c02aa => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:02.262154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87efa7c-ccc2-479b-9e5d-cb0d26d42808 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:02.307800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5720e-b20a-4d53-82b5-1f7d6e975cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:02.308600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5720e-b20a-4d53-82b5-1f7d6e975cd3 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:02.308997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5720e-b20a-4d53-82b5-1f7d6e975cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:02.309373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5720e-b20a-4d53-82b5-1f7d6e975cd3 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:02.310184 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5720e-b20a-4d53-82b5-1f7d6e975cd3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:02.311686 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5720e-b20a-4d53-82b5-1f7d6e975cd3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:02.332866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 432/876] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 16:13:02 2022] POST /identity/v3/services => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:13:02.589211 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92f0d6-7737-42f2-8127-96507df65969 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:02.589570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92f0d6-7737-42f2-8127-96507df65969 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:02.589750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92f0d6-7737-42f2-8127-96507df65969 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:02.591373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 445/877] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:02.596899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afdc12-44b4-465c-b02c-0eb98e6aed3b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:02.597191 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afdc12-44b4-465c-b02c-0eb98e6aed3b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:02.597464 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afdc12-44b4-465c-b02c-0eb98e6aed3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:02.616957 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-73afdc12-44b4-465c-b02c-0eb98e6aed3b None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:02.619465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-73afdc12-44b4-465c-b02c-0eb98e6aed3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:02.651172 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:02.701533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 433/878] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:02.977572 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92f0d6-7737-42f2-8127-96507df65969 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:03.081710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92f0d6-7737-42f2-8127-96507df65969 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:03.121271 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f27fb5-9605-4efe-91cd-86ebe65bcecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:03.121909 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f27fb5-9605-4efe-91cd-86ebe65bcecc None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:03.122231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f27fb5-9605-4efe-91cd-86ebe65bcecc None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:03.122511 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f27fb5-9605-4efe-91cd-86ebe65bcecc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:03.123100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f27fb5-9605-4efe-91cd-86ebe65bcecc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:03.124474 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f27fb5-9605-4efe-91cd-86ebe65bcecc None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:03.133573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-72f27fb5-9605-4efe-91cd-86ebe65bcecc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:13:03.133573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:03.133573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:13:03.133573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:13:03.133573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:13:03.133573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:13:03.133573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:13:03.133573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:03.133573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:13:03.133573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:03.133573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:03.133573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:03.133573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:03.133573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:03.133573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:03.133573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:03.134541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:03.134541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:03.134541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:03.134541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:03.134541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:03.134541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:03.134541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:03.134541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:13:03.134541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:13:03.134541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:13:03.134541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:13:03.134541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:03.134541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:03.134541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:03.134541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:03.134541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:03.134541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:03.135863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:03.135863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:03.135863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:03.135863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:03.135863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:03.135863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:03.135863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:03.135863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:03.135863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:03.135863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:03.135863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:13:03.135863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:03.135863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:13:03.135863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:03.135863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 446/879] 10.222.0.16 () {56 vars in 1132 bytes} [Tue Aug 23 16:13:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:03.140722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afdc12-44b4-465c-b02c-0eb98e6aed3b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:03.253113 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afdc12-44b4-465c-b02c-0eb98e6aed3b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:03.294698 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381f863-06a4-4d27-8027-fa3889cb8506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:03.295314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381f863-06a4-4d27-8027-fa3889cb8506 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:03.295597 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381f863-06a4-4d27-8027-fa3889cb8506 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:03.295865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381f863-06a4-4d27-8027-fa3889cb8506 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:03.296500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381f863-06a4-4d27-8027-fa3889cb8506 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:03.297145 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381f863-06a4-4d27-8027-fa3889cb8506 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:03.298153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381f863-06a4-4d27-8027-fa3889cb8506 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:03.303275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 434/880] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 16:13:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:03.310174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f27fb5-9605-4efe-91cd-86ebe65bcecc None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:03.326779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:03.422314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f27fb5-9605-4efe-91cd-86ebe65bcecc None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:03.459834 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac6182-e358-4c72-b17d-a622d0efd85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:03.460585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac6182-e358-4c72-b17d-a622d0efd85d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:03.461393 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac6182-e358-4c72-b17d-a622d0efd85d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:03.461831 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac6182-e358-4c72-b17d-a622d0efd85d None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:03.463004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac6182-e358-4c72-b17d-a622d0efd85d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:03.463354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac6182-e358-4c72-b17d-a622d0efd85d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:03.464729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac6182-e358-4c72-b17d-a622d0efd85d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:03.469888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 447/881] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 16:13:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:03.475792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381f863-06a4-4d27-8027-fa3889cb8506 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:03.505128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:03.589874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381f863-06a4-4d27-8027-fa3889cb8506 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:03.627962 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837a671-51b4-4820-b8fc-1e65ef21c548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:03.628622 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837a671-51b4-4820-b8fc-1e65ef21c548 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:03.628902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837a671-51b4-4820-b8fc-1e65ef21c548 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:03.629173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837a671-51b4-4820-b8fc-1e65ef21c548 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:03.629921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837a671-51b4-4820-b8fc-1e65ef21c548 None admin] RBAC: Adding query filter params (interface=public, service_id=800f65d69f3a4dd09e6cef256409219a, region_id=RegionOne) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:03.630266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837a671-51b4-4820-b8fc-1e65ef21c548 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:03.631617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837a671-51b4-4820-b8fc-1e65ef21c548 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:03.640749 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 435/882] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 23 16:13:03 2022] GET /identity/v3/endpoints?service_id=800f65d69f3a4dd09e6cef256409219a&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:03.646427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac6182-e358-4c72-b17d-a622d0efd85d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:03.723683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:03.755910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac6182-e358-4c72-b17d-a622d0efd85d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:03.797603 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d46bb4-e594-45ee-9cc5-6d9c5cfb707c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:03.798255 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d46bb4-e594-45ee-9cc5-6d9c5cfb707c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:03.798540 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d46bb4-e594-45ee-9cc5-6d9c5cfb707c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:03.798815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d46bb4-e594-45ee-9cc5-6d9c5cfb707c None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:03.799422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d46bb4-e594-45ee-9cc5-6d9c5cfb707c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:03.800793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d46bb4-e594-45ee-9cc5-6d9c5cfb707c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:03.807112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 448/883] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 23 16:13:03 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:13:04.219039 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86995b3c-1137-4d19-8444-b27d76a9d0e5 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:04.219567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86995b3c-1137-4d19-8444-b27d76a9d0e5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:04.219567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86995b3c-1137-4d19-8444-b27d76a9d0e5 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:04.221188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 436/884] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:04.226407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf29e7-d8b0-417a-9c4f-9cc78f5e862f None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:04.226876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf29e7-d8b0-417a-9c4f-9cc78f5e862f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:04.227022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf29e7-d8b0-417a-9c4f-9cc78f5e862f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:04.246054 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-13bf29e7-d8b0-417a-9c4f-9cc78f5e862f None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:04.247281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-13bf29e7-d8b0-417a-9c4f-9cc78f5e862f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:04.322341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 449/885] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:04.363425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b42d27-6b26-4b76-bf6e-5d90f969f3ac None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:04.364044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b42d27-6b26-4b76-bf6e-5d90f969f3ac None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:04.364538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b42d27-6b26-4b76-bf6e-5d90f969f3ac None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:04.366361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 437/886] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:04.371982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b4b31-fb71-4b05-8d53-8c87f3a0c0ae None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:04.372531 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b4b31-fb71-4b05-8d53-8c87f3a0c0ae None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:04.373033 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b4b31-fb71-4b05-8d53-8c87f3a0c0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:04.391530 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-0f5b4b31-fb71-4b05-8d53-8c87f3a0c0ae None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:04.393025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-0f5b4b31-fb71-4b05-8d53-8c87f3a0c0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:04.457821 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:04.466128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 450/887] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:04.480754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba505f71-1560-447a-aeab-efe63bf981c0 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:04.481144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba505f71-1560-447a-aeab-efe63bf981c0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:04.481502 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba505f71-1560-447a-aeab-efe63bf981c0 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:04.483199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 438/888] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:04.488594 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effc2e4-c156-443b-b7f6-cdc5c6ac99b2 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:04.489044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effc2e4-c156-443b-b7f6-cdc5c6ac99b2 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:04.489472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effc2e4-c156-443b-b7f6-cdc5c6ac99b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:04.509760 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-1effc2e4-c156-443b-b7f6-cdc5c6ac99b2 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:04.511226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1effc2e4-c156-443b-b7f6-cdc5c6ac99b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:04.580816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 451/889] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:04.594618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba505f71-1560-447a-aeab-efe63bf981c0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:04.687553 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:04.701995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba505f71-1560-447a-aeab-efe63bf981c0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:04.737221 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a1159-c03b-4a2f-b643-b610f4349ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:04.737833 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a1159-c03b-4a2f-b643-b610f4349ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:04.738139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a1159-c03b-4a2f-b643-b610f4349ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:04.738418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a1159-c03b-4a2f-b643-b610f4349ec6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:04.747459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effc2e4-c156-443b-b7f6-cdc5c6ac99b2 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:04.751709 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a1159-c03b-4a2f-b643-b610f4349ec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:13:04.756380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-df7a1159-c03b-4a2f-b643-b610f4349ec6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:13:04.756380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:04.756380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:04.756380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:04.756380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:04.756380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:04.756380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:04.756380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:04.756380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:04.756380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:04.756380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:04.756380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:04.756380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:13:04.756380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:13:04.756380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:13:04.756380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:13:04.757336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:13:04.757336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:13:04.757336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:13:04.757336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:13:04.757336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:04.757336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:04.757336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:04.757336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:04.757336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:04.757336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:04.757336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:04.757336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:04.757336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:04.757336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:04.757336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:04.757336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:04.759328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:04.759328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:04.759328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:04.759328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:04.759328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:13:04.759328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:13:04.759328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:13:04.759328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:13:04.759328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:13:04.759328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:13:04.759328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:13:04.759328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:04.759328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 439/890] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 23 16:13:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:04.765099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a1159-c03b-4a2f-b643-b610f4349ec6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:04.861267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effc2e4-c156-443b-b7f6-cdc5c6ac99b2 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:04.868003 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a1159-c03b-4a2f-b643-b610f4349ec6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:04.890750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:04.902234 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc169a-fb8b-441f-b42b-a3bfbdce22dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:04.902865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc169a-fb8b-441f-b42b-a3bfbdce22dd None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:04.903147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc169a-fb8b-441f-b42b-a3bfbdce22dd None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:04.903453 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc169a-fb8b-441f-b42b-a3bfbdce22dd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:04.904001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc169a-fb8b-441f-b42b-a3bfbdce22dd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:04.905371 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc169a-fb8b-441f-b42b-a3bfbdce22dd None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:04.906413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f46610-4337-40aa-b45c-5aa2a8576655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:04.907114 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f46610-4337-40aa-b45c-5aa2a8576655 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:04.907305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f46610-4337-40aa-b45c-5aa2a8576655 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:04.907569 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f46610-4337-40aa-b45c-5aa2a8576655 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:04.908239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f46610-4337-40aa-b45c-5aa2a8576655 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:04.908889 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f46610-4337-40aa-b45c-5aa2a8576655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:04.910189 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f46610-4337-40aa-b45c-5aa2a8576655 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:04.915313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-77fc169a-fb8b-441f-b42b-a3bfbdce22dd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:13:04.915313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:04.915313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:13:04.915313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:13:04.915313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:13:04.915313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:13:04.915313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:13:04.915313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:04.915313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:13:04.915313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:04.915313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:04.915313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:04.915313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:04.915313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:04.915313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:04.915313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:04.915313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:04.916315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:04.916315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:04.916315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:04.916315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:04.916315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:04.916315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:04.916315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:13:04.916315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:13:04.916315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:13:04.916315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:13:04.916315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:04.916315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:04.916315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:04.916315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:04.916315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:04.916315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:04.917171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:04.917171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:04.917171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:04.917171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:04.917171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:04.917171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:04.917171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:04.917171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:04.917171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:04.917171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:04.917171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:13:04.917171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:04.917171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:13:04.917171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:04.917171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 452/891] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 16:13:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:04.919019 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc169a-fb8b-441f-b42b-a3bfbdce22dd None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:04.924383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 440/892] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 23 16:13:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:04.925057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f46610-4337-40aa-b45c-5aa2a8576655 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:04.939734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:05.029092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc169a-fb8b-441f-b42b-a3bfbdce22dd None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:05.034242 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f46610-4337-40aa-b45c-5aa2a8576655 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:05.067254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae2a22-1c69-4182-b571-da849ee31a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:05.067880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae2a22-1c69-4182-b571-da849ee31a4d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:05.068160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae2a22-1c69-4182-b571-da849ee31a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:05.068439 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae2a22-1c69-4182-b571-da849ee31a4d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:05.069013 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae2a22-1c69-4182-b571-da849ee31a4d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:05.069815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb011dac-89d4-4dfc-b48c-7301c5b9ff22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:05.070480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae2a22-1c69-4182-b571-da849ee31a4d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:05.070591 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb011dac-89d4-4dfc-b48c-7301c5b9ff22 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:05.070943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb011dac-89d4-4dfc-b48c-7301c5b9ff22 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:05.071246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb011dac-89d4-4dfc-b48c-7301c5b9ff22 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:05.071867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb011dac-89d4-4dfc-b48c-7301c5b9ff22 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:05.072177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb011dac-89d4-4dfc-b48c-7301c5b9ff22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:05.073513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb011dac-89d4-4dfc-b48c-7301c5b9ff22 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:05.082967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 441/893] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 23 16:13:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:05.082967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb011dac-89d4-4dfc-b48c-7301c5b9ff22 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:05.083168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-a8ae2a22-1c69-4182-b571-da849ee31a4d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:13:05.083168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:05.083168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:13:05.083168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:13:05.083168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:13:05.083168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:13:05.083168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:13:05.083168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:05.083168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:13:05.083168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:05.083168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:05.083168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:05.083168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:05.083168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:05.083168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:05.083168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:05.083168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:05.084082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:05.084082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:05.084082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:05.084082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:05.084082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:05.084082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:05.084082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:13:05.084082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:13:05.084082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:13:05.084082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:13:05.084082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:05.084082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:05.084082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:05.084082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:05.084082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:05.084082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:05.084943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:05.084943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:05.084943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:05.084943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:05.084943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:05.084943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:05.084943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:05.084943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:05.084943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:05.084943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:05.084943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:13:05.084943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:05.084943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:13:05.084943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:05.084943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 453/894] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:13:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:05.085715 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae2a22-1c69-4182-b571-da849ee31a4d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:05.147055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:05.161299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:05.192067 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb011dac-89d4-4dfc-b48c-7301c5b9ff22 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:05.199157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae2a22-1c69-4182-b571-da849ee31a4d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:05.227874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8cbb62-da47-4ad4-83bc-f870606ee980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:05.228615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cbb62-da47-4ad4-83bc-f870606ee980 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:05.228967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cbb62-da47-4ad4-83bc-f870606ee980 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:05.229248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cbb62-da47-4ad4-83bc-f870606ee980 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:05.237017 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bd4dd-e899-439b-a886-ecaca219dd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:05.238156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bd4dd-e899-439b-a886-ecaca219dd04 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:05.238689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bd4dd-e899-439b-a886-ecaca219dd04 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:05.239140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bd4dd-e899-439b-a886-ecaca219dd04 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:05.239943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bd4dd-e899-439b-a886-ecaca219dd04 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:05.240247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8cbb62-da47-4ad4-83bc-f870606ee980 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:05.240608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bd4dd-e899-439b-a886-ecaca219dd04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:05.241680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8cbb62-da47-4ad4-83bc-f870606ee980 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:05.243111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bd4dd-e899-439b-a886-ecaca219dd04 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:05.248272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 454/895] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 23 16:13:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:05.249299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bd4dd-e899-439b-a886-ecaca219dd04 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:05.267914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-0f8cbb62-da47-4ad4-83bc-f870606ee980 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:05.267914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:05.267914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:05.267914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:05.267914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:05.267914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:05.267914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:05.267914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:05.267914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:05.267914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:05.267914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:05.267914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:05.267914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:05.267914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:05.267914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:05.267914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:05.268946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:05.268946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:05.268946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:05.268946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:05.268946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:05.268946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:05.268946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:05.268946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:05.268946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:05.268946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:05.268946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:05.268946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:05.268946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:05.268946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:05.268946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:05.268946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:05.268946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:05.269849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:05.269849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:05.269849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:05.269849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 442/896] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:05.277626 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8cbb62-da47-4ad4-83bc-f870606ee980 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:05.384697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bd4dd-e899-439b-a886-ecaca219dd04 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:05.405316 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:05.423935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8cbb62-da47-4ad4-83bc-f870606ee980 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:05.431045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1476bf0-8fed-46de-bc71-0cba7d571de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:05.431657 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1476bf0-8fed-46de-bc71-0cba7d571de4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:05.431937 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1476bf0-8fed-46de-bc71-0cba7d571de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:05.432210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1476bf0-8fed-46de-bc71-0cba7d571de4 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:05.432850 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1476bf0-8fed-46de-bc71-0cba7d571de4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:05.433155 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1476bf0-8fed-46de-bc71-0cba7d571de4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:05.434559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1476bf0-8fed-46de-bc71-0cba7d571de4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:05.440271 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 455/897] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:13:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:05.446860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1476bf0-8fed-46de-bc71-0cba7d571de4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:05.458438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:05.466757 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016231e-ff30-4979-b1c5-d66b5b8123ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:05.467373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016231e-ff30-4979-b1c5-d66b5b8123ac None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:05.467960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016231e-ff30-4979-b1c5-d66b5b8123ac None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:05.468253 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016231e-ff30-4979-b1c5-d66b5b8123ac None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:05.468906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016231e-ff30-4979-b1c5-d66b5b8123ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:05.469210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016231e-ff30-4979-b1c5-d66b5b8123ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:05.471405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016231e-ff30-4979-b1c5-d66b5b8123ac None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:05.494051 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 443/898] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:05.495364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016231e-ff30-4979-b1c5-d66b5b8123ac None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:05.578613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1476bf0-8fed-46de-bc71-0cba7d571de4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:05.606426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016231e-ff30-4979-b1c5-d66b5b8123ac None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:05.616854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fad22-c573-4862-9411-3b2835d05ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:05.617864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fad22-c573-4862-9411-3b2835d05ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:05.618364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fad22-c573-4862-9411-3b2835d05ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:05.618927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fad22-c573-4862-9411-3b2835d05ef4 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:05.619846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fad22-c573-4862-9411-3b2835d05ef4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:05.620331 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fad22-c573-4862-9411-3b2835d05ef4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:05.622042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fad22-c573-4862-9411-3b2835d05ef4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:05.627962 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 456/899] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:13:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:05.639290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fad22-c573-4862-9411-3b2835d05ef4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:05.647032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b631a3-db97-4f74-9c01-f1eebe4e4a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:05.647949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b631a3-db97-4f74-9c01-f1eebe4e4a30 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:05.648482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b631a3-db97-4f74-9c01-f1eebe4e4a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:05.648963 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b631a3-db97-4f74-9c01-f1eebe4e4a30 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:05.657336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b631a3-db97-4f74-9c01-f1eebe4e4a30 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:05.659438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b631a3-db97-4f74-9c01-f1eebe4e4a30 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:05.672232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-d1b631a3-db97-4f74-9c01-f1eebe4e4a30 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:13:05.672232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:05.672232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:05.672232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:05.672232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:05.672232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:05.672232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:05.672232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:05.672232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:05.672232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:05.672232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:05.672232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:05.672232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:13:05.672232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:13:05.672232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:13:05.672232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:13:05.673192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:05.673192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:05.673192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:13:05.673192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:05.673192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:13:05.673192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:05.673192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:05.673192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:05.673192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:05.673192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:05.673192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:05.673192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:05.673192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:05.673192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:05.673192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:05.673192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:05.673192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:05.673192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:05.674170 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:05.674170 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:05.674170 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:13:05.674170 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:13:05.674170 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:13:05.674170 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:13:05.674170 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:13:05.674170 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:13:05.674170 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:13:05.674170 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:05.681173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 444/900] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 23 16:13:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:05.682739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b631a3-db97-4f74-9c01-f1eebe4e4a30 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:05.696176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:05.739438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:05.753755 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fad22-c573-4862-9411-3b2835d05ef4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:05.790749 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5c1e2-077f-418f-8667-1bf9400de233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:05.791363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5c1e2-077f-418f-8667-1bf9400de233 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:05.791647 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5c1e2-077f-418f-8667-1bf9400de233 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:05.791927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5c1e2-077f-418f-8667-1bf9400de233 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:05.792633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5c1e2-077f-418f-8667-1bf9400de233 None admin] RBAC: Adding query filter params (interface=public, service_id=8eceef23f6b744c4bfcf5bd89231cfff, region_id=RegionOne) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:05.792948 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5c1e2-077f-418f-8667-1bf9400de233 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:05.794343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5c1e2-077f-418f-8667-1bf9400de233 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:05.799766 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 457/901] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 23 16:13:05 2022] GET /identity/v3/endpoints?service_id=8eceef23f6b744c4bfcf5bd89231cfff&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:05.800573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b631a3-db97-4f74-9c01-f1eebe4e4a30 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:05.800762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a54344-2cb2-4e15-ba6e-819f6d0693b6 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:05.801050 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a54344-2cb2-4e15-ba6e-819f6d0693b6 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:05.801327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a54344-2cb2-4e15-ba6e-819f6d0693b6 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:05.810261 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 458/902] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:05.810261 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a54344-2cb2-4e15-ba6e-819f6d0693b6 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:05.836255 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c98bf1-ba3f-45ee-bc56-3867002a001c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:05.836851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c98bf1-ba3f-45ee-bc56-3867002a001c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:05.837136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c98bf1-ba3f-45ee-bc56-3867002a001c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:05.837412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c98bf1-ba3f-45ee-bc56-3867002a001c None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:05.838175 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c98bf1-ba3f-45ee-bc56-3867002a001c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:05.838486 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c98bf1-ba3f-45ee-bc56-3867002a001c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:05.839912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c98bf1-ba3f-45ee-bc56-3867002a001c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:05.857352 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 445/903] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 23 16:13:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:05.858614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fa112-bab9-45d8-9f9c-6de5dd667899 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:05.858904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fa112-bab9-45d8-9f9c-6de5dd667899 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:05.859176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fa112-bab9-45d8-9f9c-6de5dd667899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:05.878015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-666fa112-bab9-45d8-9f9c-6de5dd667899 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:05.879220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-666fa112-bab9-45d8-9f9c-6de5dd667899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:05.926489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a54344-2cb2-4e15-ba6e-819f6d0693b6 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:05.939096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:05.952016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 446/904] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:05.953438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fa112-bab9-45d8-9f9c-6de5dd667899 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:05.977343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaafc8d-c20f-4a13-9703-9d223555cf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:05.978505 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaafc8d-c20f-4a13-9703-9d223555cf50 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:05.979002 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaafc8d-c20f-4a13-9703-9d223555cf50 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:05.979360 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaafc8d-c20f-4a13-9703-9d223555cf50 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:05.980076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaafc8d-c20f-4a13-9703-9d223555cf50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:05.981769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaafc8d-c20f-4a13-9703-9d223555cf50 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:05.996746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 459/905] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 23 16:13:05 2022] GET /identity/v3/services => generated 1268 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:13:05.999926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:06.077574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fa112-bab9-45d8-9f9c-6de5dd667899 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:06.115265 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda58d5-2718-4cdf-a167-7481c643eda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:06.116188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda58d5-2718-4cdf-a167-7481c643eda5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:06.116655 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda58d5-2718-4cdf-a167-7481c643eda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:06.117757 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda58d5-2718-4cdf-a167-7481c643eda5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:06.204876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda58d5-2718-4cdf-a167-7481c643eda5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:06.206422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eda58d5-2718-4cdf-a167-7481c643eda5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:06.241696 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:06.262131 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaafc8d-c20f-4a13-9703-9d223555cf50 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:06.315457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 447/906] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:13:05 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:13:06.322809 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda58d5-2718-4cdf-a167-7481c643eda5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:06.409107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaafc8d-c20f-4a13-9703-9d223555cf50 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:06.453394 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eda58d5-2718-4cdf-a167-7481c643eda5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:06.455840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8d3d0-82bd-4f79-99ae-6a7c59ce1df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:06.456747 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d3d0-82bd-4f79-99ae-6a7c59ce1df2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:06.457229 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d3d0-82bd-4f79-99ae-6a7c59ce1df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:06.457732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8d3d0-82bd-4f79-99ae-6a7c59ce1df2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:06.458558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8d3d0-82bd-4f79-99ae-6a7c59ce1df2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:06.460127 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8d3d0-82bd-4f79-99ae-6a7c59ce1df2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:06.470990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-c8a8d3d0-82bd-4f79-99ae-6a7c59ce1df2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:13:06.470990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:06.470990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:13:06.470990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:13:06.470990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:13:06.470990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:13:06.470990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:13:06.470990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:06.470990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:13:06.470990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:06.470990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:06.470990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:06.470990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:06.470990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:06.470990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:06.470990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:06.472001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:06.472001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:06.472001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:06.472001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:06.472001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:06.472001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:06.472001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:06.472001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:13:06.472001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:13:06.472001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:13:06.472001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:13:06.472001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:06.472001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:06.472001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:06.472001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:06.472001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:06.472001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:06.472939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:06.472939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:06.472939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:06.472939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:06.472939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:06.472939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:06.472939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:06.472939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:06.472939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:06.472939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:06.472939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:13:06.472939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:06.472939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 16:13:06.472939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:06.481408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 460/907] 10.222.0.16 () {56 vars in 1132 bytes} [Tue Aug 23 16:13:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:06.483094 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8d3d0-82bd-4f79-99ae-6a7c59ce1df2 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:06.492773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85033bfa-b915-424c-9beb-98699a194331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:06.493398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85033bfa-b915-424c-9beb-98699a194331 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:06.493691 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85033bfa-b915-424c-9beb-98699a194331 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:06.493964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85033bfa-b915-424c-9beb-98699a194331 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:06.496191 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:06.509030 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85033bfa-b915-424c-9beb-98699a194331 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:06.510753 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85033bfa-b915-424c-9beb-98699a194331 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:06.529260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-85033bfa-b915-424c-9beb-98699a194331 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:06.529260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:06.529260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:06.529260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:06.529260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:06.529260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:06.529260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:06.529260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:06.529260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:06.529260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:06.529260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:06.529260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:06.529260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:06.529260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:06.529260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:06.529260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:06.530328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:06.530328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:06.530328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:06.530328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:06.530328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:06.530328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:06.530328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:06.530328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:06.530328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:06.530328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:06.530328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:06.530328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:06.530328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:06.530328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:06.530328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:06.530328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:06.530328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:06.531229 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:06.531229 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:06.531229 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:06.534132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 448/908] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:06.540246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85033bfa-b915-424c-9beb-98699a194331 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:06.545833 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:06.630200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8d3d0-82bd-4f79-99ae-6a7c59ce1df2 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:06.669639 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85033bfa-b915-424c-9beb-98699a194331 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:06.674461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030aa264-6a48-4830-9295-44c6710394d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:06.675380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030aa264-6a48-4830-9295-44c6710394d4 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:06.675865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030aa264-6a48-4830-9295-44c6710394d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:06.676365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030aa264-6a48-4830-9295-44c6710394d4 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:06.677195 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030aa264-6a48-4830-9295-44c6710394d4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:06.678227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030aa264-6a48-4830-9295-44c6710394d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:06.681087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030aa264-6a48-4830-9295-44c6710394d4 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:06.691938 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 461/909] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 16:13:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:06.693601 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030aa264-6a48-4830-9295-44c6710394d4 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:06.716979 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c47586-cf70-40cf-bc11-7f45974b5982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:06.717526 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c47586-cf70-40cf-bc11-7f45974b5982 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:06.717813 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c47586-cf70-40cf-bc11-7f45974b5982 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:06.718107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c47586-cf70-40cf-bc11-7f45974b5982 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:06.718763 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c47586-cf70-40cf-bc11-7f45974b5982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:06.719069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c47586-cf70-40cf-bc11-7f45974b5982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:06.720897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c47586-cf70-40cf-bc11-7f45974b5982 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:06.741113 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 449/910] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:06.743396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c47586-cf70-40cf-bc11-7f45974b5982 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:06.797098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:06.813287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030aa264-6a48-4830-9295-44c6710394d4 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:06.814968 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:06.850049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a89dae-4ce0-49b0-b5a6-e34034e033f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:06.850740 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a89dae-4ce0-49b0-b5a6-e34034e033f2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:06.851028 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a89dae-4ce0-49b0-b5a6-e34034e033f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:06.851326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a89dae-4ce0-49b0-b5a6-e34034e033f2 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:06.852250 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a89dae-4ce0-49b0-b5a6-e34034e033f2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:06.852554 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a89dae-4ce0-49b0-b5a6-e34034e033f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:06.853926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a89dae-4ce0-49b0-b5a6-e34034e033f2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:06.863658 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 462/911] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 16:13:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:06.865190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a89dae-4ce0-49b0-b5a6-e34034e033f2 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:06.866405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c47586-cf70-40cf-bc11-7f45974b5982 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:06.911847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864033b-e398-42c8-9a3f-f48320905ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:06.912513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864033b-e398-42c8-9a3f-f48320905ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:06.912801 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864033b-e398-42c8-9a3f-f48320905ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:06.913063 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864033b-e398-42c8-9a3f-f48320905ea0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:06.921073 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864033b-e398-42c8-9a3f-f48320905ea0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:06.922909 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864033b-e398-42c8-9a3f-f48320905ea0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:06.938206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e864033b-e398-42c8-9a3f-f48320905ea0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:06.938206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:06.938206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:06.938206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:06.938206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:06.938206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:06.938206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:06.938206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:06.938206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:06.938206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:06.938206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:06.938206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:06.938206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:13:06.938206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:13:06.938206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:13:06.939163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:13:06.939163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:06.939163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:06.939163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:06.939163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:06.939163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:06.939163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:06.939163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:06.939163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:06.939163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:06.939163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:06.939163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:06.939163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:06.939163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:06.939163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:06.939163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:06.939163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:06.940057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:13:06.940057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:13:06.940057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:13:06.940057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:13:06.940057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:13:06.940057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:13:06.940057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:06.940057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:06.942148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 450/912] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:13:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:06.946013 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864033b-e398-42c8-9a3f-f48320905ea0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:06.993334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a89dae-4ce0-49b0-b5a6-e34034e033f2 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:07.030244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c325d1-ebc8-454b-a7df-95fba3d9557a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:07.030861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c325d1-ebc8-454b-a7df-95fba3d9557a None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:07.031142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c325d1-ebc8-454b-a7df-95fba3d9557a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:07.031418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c325d1-ebc8-454b-a7df-95fba3d9557a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:07.032092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c325d1-ebc8-454b-a7df-95fba3d9557a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:07.033730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c325d1-ebc8-454b-a7df-95fba3d9557a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:07.058095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 463/913] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 16:13:06 2022] POST /identity/v3/endpoints => generated 347 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:13:07.074241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864033b-e398-42c8-9a3f-f48320905ea0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:07.105829 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:07.122194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5708a31-0c39-4467-bdd3-1afc0e0a4ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:07.123144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5708a31-0c39-4467-bdd3-1afc0e0a4ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:07.123646 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5708a31-0c39-4467-bdd3-1afc0e0a4ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:07.124103 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5708a31-0c39-4467-bdd3-1afc0e0a4ce5 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:07.125021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5708a31-0c39-4467-bdd3-1afc0e0a4ce5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:07.125523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5708a31-0c39-4467-bdd3-1afc0e0a4ce5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:07.127561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5708a31-0c39-4467-bdd3-1afc0e0a4ce5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:07.143342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 451/914] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:13:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:07.150331 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c325d1-ebc8-454b-a7df-95fba3d9557a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:07.183640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:07.269961 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f15c10-9179-4b19-bade-4c1841677a53 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:07.270491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f15c10-9179-4b19-bade-4c1841677a53 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:07.270588 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c325d1-ebc8-454b-a7df-95fba3d9557a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:07.270936 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f15c10-9179-4b19-bade-4c1841677a53 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:07.271914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 452/915] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:13:07.277600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e97a58-ecb2-468f-acbc-79f5ea9ec89b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:07.277880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e97a58-ecb2-468f-acbc-79f5ea9ec89b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:07.278203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e97a58-ecb2-468f-acbc-79f5ea9ec89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:07.301175 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-61e97a58-ecb2-468f-acbc-79f5ea9ec89b None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:07.303414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-61e97a58-ecb2-468f-acbc-79f5ea9ec89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:07.313402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54860682-6e42-4e74-95c6-41fb72f4550b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:07.314016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54860682-6e42-4e74-95c6-41fb72f4550b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:07.314353 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54860682-6e42-4e74-95c6-41fb72f4550b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:07.314621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54860682-6e42-4e74-95c6-41fb72f4550b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:07.315456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54860682-6e42-4e74-95c6-41fb72f4550b None admin] RBAC: Adding query filter params (role.id=361e9c2a98ae4a7f925cd3ec46baf425, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=5fe3a02c2bc247efa354ca5bac39ec4e) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:07.315762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54860682-6e42-4e74-95c6-41fb72f4550b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:07.317306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54860682-6e42-4e74-95c6-41fb72f4550b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:07.324274 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 464/916] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:13:07 2022] GET /identity/v3/role_assignments?user.id=5fe3a02c2bc247efa354ca5bac39ec4e&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=361e9c2a98ae4a7f925cd3ec46baf425 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:07.385980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 453/917] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:07.661749 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54860682-6e42-4e74-95c6-41fb72f4550b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:07.756550 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:07.772365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54860682-6e42-4e74-95c6-41fb72f4550b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:07.810388 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e89ead-9318-4f20-a0f3-dc3c886f1389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:07.811003 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e89ead-9318-4f20-a0f3-dc3c886f1389 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:07.811287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e89ead-9318-4f20-a0f3-dc3c886f1389 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:07.811561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e89ead-9318-4f20-a0f3-dc3c886f1389 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:07.812229 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e89ead-9318-4f20-a0f3-dc3c886f1389 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:07.813612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e89ead-9318-4f20-a0f3-dc3c886f1389 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:07.830754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 465/918] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 16:13:07 2022] POST /identity/v3/services => generated 241 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:13:08.027191 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d6245-30b1-4c3b-84bb-ad63d6851ad5 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:08.027438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d6245-30b1-4c3b-84bb-ad63d6851ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:08.027681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d6245-30b1-4c3b-84bb-ad63d6851ad5 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:08.029261 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 454/919] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:08.034788 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16177a9b-a914-41cc-9749-8c876d37f5cb None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:08.035086 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16177a9b-a914-41cc-9749-8c876d37f5cb None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:08.035367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16177a9b-a914-41cc-9749-8c876d37f5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:08.054190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-16177a9b-a914-41cc-9749-8c876d37f5cb None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:08.055994 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-16177a9b-a914-41cc-9749-8c876d37f5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:08.132265 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 466/920] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:08.402637 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d6245-30b1-4c3b-84bb-ad63d6851ad5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:08.505362 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:08.515486 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d6245-30b1-4c3b-84bb-ad63d6851ad5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:08.551385 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219f04c-d951-45d6-a4cd-0a4e8bc26ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:08.552020 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219f04c-d951-45d6-a4cd-0a4e8bc26ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:08.552302 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219f04c-d951-45d6-a4cd-0a4e8bc26ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:08.552629 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219f04c-d951-45d6-a4cd-0a4e8bc26ca2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:08.553216 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219f04c-d951-45d6-a4cd-0a4e8bc26ca2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:08.554719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219f04c-d951-45d6-a4cd-0a4e8bc26ca2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:08.563596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-1219f04c-d951-45d6-a4cd-0a4e8bc26ca2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:13:08.563596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:08.563596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:13:08.563596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:13:08.563596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:13:08.563596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:13:08.563596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:13:08.563596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:08.563596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:13:08.563596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:08.563596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:08.563596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:08.563596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:08.563596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:08.563596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:08.563596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:08.563596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:08.564581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:08.564581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:08.564581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:08.564581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:08.564581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:08.564581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:08.564581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:13:08.564581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:13:08.564581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:13:08.564581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:13:08.564581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:08.564581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:08.564581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:08.564581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:08.564581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:08.564581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:08.565964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:08.565964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:08.565964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:08.565964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:08.565964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:08.565964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:08.565964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:08.565964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:08.565964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:08.565964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:08.565964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:13:08.565964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:08.565964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 16:13:08.565964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:08.565964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 455/921] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:13:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:08.571389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16177a9b-a914-41cc-9749-8c876d37f5cb None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:08.644470 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:08.686431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16177a9b-a914-41cc-9749-8c876d37f5cb None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:08.721141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623982bb-a97c-41b7-af3d-fafb346b8aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:08.721745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623982bb-a97c-41b7-af3d-fafb346b8aec None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:08.722017 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623982bb-a97c-41b7-af3d-fafb346b8aec None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:08.722324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623982bb-a97c-41b7-af3d-fafb346b8aec None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:08.722969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623982bb-a97c-41b7-af3d-fafb346b8aec None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:08.723250 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623982bb-a97c-41b7-af3d-fafb346b8aec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:08.724607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623982bb-a97c-41b7-af3d-fafb346b8aec None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:08.730658 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 467/922] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:13:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:08.735985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219f04c-d951-45d6-a4cd-0a4e8bc26ca2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:08.839414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219f04c-d951-45d6-a4cd-0a4e8bc26ca2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:08.875094 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379a98f-5b73-42d9-a4f4-043808903516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:08.875714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379a98f-5b73-42d9-a4f4-043808903516 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:08.875996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379a98f-5b73-42d9-a4f4-043808903516 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:08.876274 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379a98f-5b73-42d9-a4f4-043808903516 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:08.876918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379a98f-5b73-42d9-a4f4-043808903516 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:08.877231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379a98f-5b73-42d9-a4f4-043808903516 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:08.878623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379a98f-5b73-42d9-a4f4-043808903516 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:08.884099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 456/923] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 16:13:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:08.889456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623982bb-a97c-41b7-af3d-fafb346b8aec None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:08.997956 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623982bb-a97c-41b7-af3d-fafb346b8aec None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:09.033154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627e329-8570-4758-80e9-4bc271ccdc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:09.034017 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627e329-8570-4758-80e9-4bc271ccdc01 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:09.034318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627e329-8570-4758-80e9-4bc271ccdc01 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:09.034582 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627e329-8570-4758-80e9-4bc271ccdc01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:09.035246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627e329-8570-4758-80e9-4bc271ccdc01 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:09.036598 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627e329-8570-4758-80e9-4bc271ccdc01 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:09.042543 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:09.059804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 468/924] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 16:13:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:13:09.212762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd5fb1-ac91-4cc5-a4a1-3ff689e25271 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:09.213094 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd5fb1-ac91-4cc5-a4a1-3ff689e25271 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:09.213316 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd5fb1-ac91-4cc5-a4a1-3ff689e25271 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:09.214924 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 457/925] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:09.220104 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a4ba8-d3de-49d7-aa70-bf34f1463129 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:09.220380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a4ba8-d3de-49d7-aa70-bf34f1463129 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:09.220659 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a4ba8-d3de-49d7-aa70-bf34f1463129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:09.241691 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-fd0a4ba8-d3de-49d7-aa70-bf34f1463129 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:09.243637 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-fd0a4ba8-d3de-49d7-aa70-bf34f1463129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:09.321718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 469/926] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:09.386429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fd759-d2a2-453f-9537-97bc252d39c5 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:09.386750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fd759-d2a2-453f-9537-97bc252d39c5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:09.387004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fd759-d2a2-453f-9537-97bc252d39c5 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:09.388592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 458/927] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:09.393886 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c9bb5-0d71-49da-b796-762507e31373 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:09.394226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c9bb5-0d71-49da-b796-762507e31373 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:09.394501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c9bb5-0d71-49da-b796-762507e31373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:09.413246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-179c9bb5-0d71-49da-b796-762507e31373 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:09.415156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-179c9bb5-0d71-49da-b796-762507e31373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:09.487145 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 470/928] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:09.596287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fd759-d2a2-453f-9537-97bc252d39c5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:09.619898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:09.703804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fd759-d2a2-453f-9537-97bc252d39c5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:09.738054 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb64f5b-4be6-47dd-8809-24c2334da123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:09.738711 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb64f5b-4be6-47dd-8809-24c2334da123 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:09.738988 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb64f5b-4be6-47dd-8809-24c2334da123 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:09.739315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb64f5b-4be6-47dd-8809-24c2334da123 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:09.739899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb64f5b-4be6-47dd-8809-24c2334da123 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:09.741466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb64f5b-4be6-47dd-8809-24c2334da123 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:09.751426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-efb64f5b-4be6-47dd-8809-24c2334da123 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:13:09.751426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:09.751426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:13:09.751426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:13:09.751426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:13:09.751426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:13:09.751426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:13:09.751426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:09.751426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:13:09.751426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:09.751426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:09.751426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:09.751426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:09.751426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:09.751426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:09.751426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:09.751426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:09.752456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:09.752456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:09.752456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:09.752456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:09.752456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:09.752456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:09.752456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:13:09.752456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:13:09.752456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:13:09.752456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:13:09.752456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:09.752456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:09.752456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:09.752456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:09.752456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:09.752456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:09.753300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:09.753300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:09.753300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:09.753300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:09.753300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:09.753300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:09.753300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:09.753300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:09.753300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:09.753300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:09.753300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:13:09.753300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:09.753300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:13:09.753300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:09.753300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 459/929] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:13:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:09.759762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c9bb5-0d71-49da-b796-762507e31373 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:09.770654 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb64f5b-4be6-47dd-8809-24c2334da123 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:09.814481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:09.874633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c9bb5-0d71-49da-b796-762507e31373 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:09.880307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:09.896523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb64f5b-4be6-47dd-8809-24c2334da123 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:09.922397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf567f27-7eaf-4cf3-ac1e-19743fbb4b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:09.923826 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf567f27-7eaf-4cf3-ac1e-19743fbb4b2a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:09.924592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf567f27-7eaf-4cf3-ac1e-19743fbb4b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:09.925069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf567f27-7eaf-4cf3-ac1e-19743fbb4b2a None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:09.926090 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf567f27-7eaf-4cf3-ac1e-19743fbb4b2a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:09.926714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf567f27-7eaf-4cf3-ac1e-19743fbb4b2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:09.928105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf567f27-7eaf-4cf3-ac1e-19743fbb4b2a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:09.933037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 471/930] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 16:13:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:09.934231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599e642-b898-4ef5-b21d-b6f39d0474ab None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:09.934702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599e642-b898-4ef5-b21d-b6f39d0474ab None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:09.935129 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599e642-b898-4ef5-b21d-b6f39d0474ab None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:09.936747 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 472/931] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:09.938738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aab6fd-4648-4a98-a10b-46ecd188aab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:09.939501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599e642-b898-4ef5-b21d-b6f39d0474ab None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:09.939611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aab6fd-4648-4a98-a10b-46ecd188aab7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:09.939905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aab6fd-4648-4a98-a10b-46ecd188aab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:09.940200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aab6fd-4648-4a98-a10b-46ecd188aab7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:09.951900 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aab6fd-4648-4a98-a10b-46ecd188aab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:13:09.956861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-01aab6fd-4648-4a98-a10b-46ecd188aab7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:13:09.956861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:09.956861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:09.956861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:09.956861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:09.956861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:09.956861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:09.956861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:09.956861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:09.956861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:09.956861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:09.956861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:09.956861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:13:09.956861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:13:09.956861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:13:09.956861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:13:09.958004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:13:09.958004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:13:09.958004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:13:09.958004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:13:09.958004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:09.958004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:09.958004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:09.958004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:09.958004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:09.958004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:09.958004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:09.958004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:09.958004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:09.958004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:09.958004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:09.958004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:09.959078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:09.959078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:09.959078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:09.959078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:09.959078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:13:09.959078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:13:09.959078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:13:09.959078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:13:09.959078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:13:09.959078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:13:09.959078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:13:09.959078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:09.962077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 460/932] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 23 16:13:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:09.963419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a1442-5c66-4006-b334-602911c2112e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:09.963859 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a1442-5c66-4006-b334-602911c2112e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:09.964142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a1442-5c66-4006-b334-602911c2112e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:09.982047 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fa7a1442-5c66-4006-b334-602911c2112e None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:09.983367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fa7a1442-5c66-4006-b334-602911c2112e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:10.057252 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 461/933] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:10.058130 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a1442-5c66-4006-b334-602911c2112e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:10.071246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599e642-b898-4ef5-b21d-b6f39d0474ab None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:10.091156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:10.121444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03b9aa-5087-4681-b6b0-408eb4b4b4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:10.122343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03b9aa-5087-4681-b6b0-408eb4b4b4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:10.122803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03b9aa-5087-4681-b6b0-408eb4b4b4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:10.123261 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03b9aa-5087-4681-b6b0-408eb4b4b4c0 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:10.124054 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03b9aa-5087-4681-b6b0-408eb4b4b4c0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:10.125098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03b9aa-5087-4681-b6b0-408eb4b4b4c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:10.126985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03b9aa-5087-4681-b6b0-408eb4b4b4c0 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:10.134536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 473/934] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 16:13:09 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:10.154094 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:10.186132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a1442-5c66-4006-b334-602911c2112e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:10.221037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a7043-0408-45c1-889a-edb1f22277d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:10.221673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a7043-0408-45c1-889a-edb1f22277d8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:10.221958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a7043-0408-45c1-889a-edb1f22277d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:10.222260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a7043-0408-45c1-889a-edb1f22277d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:10.222952 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a7043-0408-45c1-889a-edb1f22277d8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:10.223253 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a7043-0408-45c1-889a-edb1f22277d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:10.224685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a7043-0408-45c1-889a-edb1f22277d8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:10.235311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 462/935] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 23 16:13:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:10.240644 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03b9aa-5087-4681-b6b0-408eb4b4b4c0 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:10.353606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03b9aa-5087-4681-b6b0-408eb4b4b4c0 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:10.359024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a7043-0408-45c1-889a-edb1f22277d8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:10.390775 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f17059-dd2b-445b-8b0a-b2ac01465e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:10.391326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f17059-dd2b-445b-8b0a-b2ac01465e2b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:10.391604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f17059-dd2b-445b-8b0a-b2ac01465e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:10.391877 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f17059-dd2b-445b-8b0a-b2ac01465e2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:10.402921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f17059-dd2b-445b-8b0a-b2ac01465e2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:10.404462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f17059-dd2b-445b-8b0a-b2ac01465e2b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:10.420617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-04f17059-dd2b-445b-8b0a-b2ac01465e2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:10.420617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:10.420617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:10.420617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:10.420617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:10.420617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:10.420617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:10.420617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:10.420617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:10.420617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:10.420617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:10.420617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:10.420617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:10.420617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:10.420617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:10.420617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:10.421785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:10.421785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:10.421785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:10.421785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:10.421785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:10.421785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:10.421785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:10.421785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:10.421785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:10.421785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:10.421785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:10.421785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:10.421785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:10.421785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:10.421785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:10.421785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:10.421785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:10.423002 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:10.423002 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:10.423002 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:10.424974 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 474/936] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:10.431034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f17059-dd2b-445b-8b0a-b2ac01465e2b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:10.462456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:10.472665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a7043-0408-45c1-889a-edb1f22277d8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:10.509879 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7e40a-59b2-420c-9240-3e20c0ecfc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:10.510549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7e40a-59b2-420c-9240-3e20c0ecfc6c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:10.510828 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7e40a-59b2-420c-9240-3e20c0ecfc6c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:10.511102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7e40a-59b2-420c-9240-3e20c0ecfc6c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:10.511691 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7e40a-59b2-420c-9240-3e20c0ecfc6c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:10.513054 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7e40a-59b2-420c-9240-3e20c0ecfc6c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:10.515828 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:10.522750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-34a7e40a-59b2-420c-9240-3e20c0ecfc6c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:13:10.522750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:10.522750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:13:10.522750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:13:10.522750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:13:10.522750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:13:10.522750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:13:10.522750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:10.522750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:13:10.522750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:10.522750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:10.522750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:10.522750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:10.522750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:10.522750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:10.522750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:10.522750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:10.524750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:10.524750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:10.524750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:10.524750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:10.524750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:10.524750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:10.524750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:13:10.524750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:13:10.524750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:13:10.524750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:13:10.524750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:10.524750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:10.524750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:10.524750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:10.524750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:10.524750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:10.525583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:10.525583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:10.525583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:10.525583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:10.525583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:10.525583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:10.525583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:10.525583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:10.525583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:10.525583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:10.525583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:13:10.525583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:10.525583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:13:10.525583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:10.525583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 463/937] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 16:13:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:10.530333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7e40a-59b2-420c-9240-3e20c0ecfc6c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:10.546803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f17059-dd2b-445b-8b0a-b2ac01465e2b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:10.582408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f6552-8820-4122-b996-efd4b65bc240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:10.583351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f6552-8820-4122-b996-efd4b65bc240 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:10.583816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f6552-8820-4122-b996-efd4b65bc240 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:10.584263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f6552-8820-4122-b996-efd4b65bc240 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:10.585086 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f6552-8820-4122-b996-efd4b65bc240 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:10.585591 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f6552-8820-4122-b996-efd4b65bc240 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:10.587345 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f6552-8820-4122-b996-efd4b65bc240 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:10.599945 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 475/938] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:10.608143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f6552-8820-4122-b996-efd4b65bc240 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:10.651157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7e40a-59b2-420c-9240-3e20c0ecfc6c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:10.692519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef2bed-9bac-4024-8eca-2e63be6ffd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:10.693736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef2bed-9bac-4024-8eca-2e63be6ffd07 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:10.694020 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef2bed-9bac-4024-8eca-2e63be6ffd07 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:10.694328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef2bed-9bac-4024-8eca-2e63be6ffd07 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:10.695367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef2bed-9bac-4024-8eca-2e63be6ffd07 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:10.695673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef2bed-9bac-4024-8eca-2e63be6ffd07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:10.698287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef2bed-9bac-4024-8eca-2e63be6ffd07 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:10.704067 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 464/939] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 23 16:13:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:10.710112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef2bed-9bac-4024-8eca-2e63be6ffd07 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:10.720707 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:10.738483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f6552-8820-4122-b996-efd4b65bc240 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:10.776658 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12984213-fcee-4e60-b994-83d66f162047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:10.777347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12984213-fcee-4e60-b994-83d66f162047 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:10.777802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12984213-fcee-4e60-b994-83d66f162047 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:10.778029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12984213-fcee-4e60-b994-83d66f162047 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:10.786006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12984213-fcee-4e60-b994-83d66f162047 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:10.787551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12984213-fcee-4e60-b994-83d66f162047 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:10.800646 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:10.801449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-12984213-fcee-4e60-b994-83d66f162047 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:13:10.801449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:10.801449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:10.801449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:10.801449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:10.801449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:10.801449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:10.801449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:10.801449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:10.801449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:10.801449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:10.801449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:10.801449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:13:10.801449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:13:10.801449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:13:10.801449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:13:10.802864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:10.802864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:10.802864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:13:10.802864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:10.802864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:13:10.802864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:10.802864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:10.802864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:10.802864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:10.802864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:10.802864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:10.802864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:10.802864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:10.802864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:10.802864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:10.802864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:10.802864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:10.802864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:10.804112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:10.804112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:10.804112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:13:10.804112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:13:10.804112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:13:10.804112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:13:10.804112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:13:10.804112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:13:10.804112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:13:10.804112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:10.808310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 476/940] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 23 16:13:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:10.809597 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12984213-fcee-4e60-b994-83d66f162047 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:10.858137 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef2bed-9bac-4024-8eca-2e63be6ffd07 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:10.894356 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eec3f5-6ee0-4b5c-8a03-8aa1b74e0605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:10.895108 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eec3f5-6ee0-4b5c-8a03-8aa1b74e0605 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:10.895528 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eec3f5-6ee0-4b5c-8a03-8aa1b74e0605 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:10.895893 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eec3f5-6ee0-4b5c-8a03-8aa1b74e0605 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:10.896792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eec3f5-6ee0-4b5c-8a03-8aa1b74e0605 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:10.897185 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eec3f5-6ee0-4b5c-8a03-8aa1b74e0605 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:10.899009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eec3f5-6ee0-4b5c-8a03-8aa1b74e0605 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:10.909412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 465/941] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 23 16:13:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:10.910696 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eec3f5-6ee0-4b5c-8a03-8aa1b74e0605 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:10.937358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12984213-fcee-4e60-b994-83d66f162047 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:10.985779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492233e-136e-40e9-a7c4-a3c67adffb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:10.986660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492233e-136e-40e9-a7c4-a3c67adffb53 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:10.987091 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492233e-136e-40e9-a7c4-a3c67adffb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:10.987533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492233e-136e-40e9-a7c4-a3c67adffb53 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:10.988435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492233e-136e-40e9-a7c4-a3c67adffb53 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:10.988889 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492233e-136e-40e9-a7c4-a3c67adffb53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:10.991054 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492233e-136e-40e9-a7c4-a3c67adffb53 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:11.018359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eec3f5-6ee0-4b5c-8a03-8aa1b74e0605 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:11.019299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 477/942] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 23 16:13:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:11.020662 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492233e-136e-40e9-a7c4-a3c67adffb53 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:11.030526 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:11.056823 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:11.067486 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc52499-a10a-434b-a2e1-736f51a6aec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:11.068333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52499-a10a-434b-a2e1-736f51a6aec3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:11.068762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52499-a10a-434b-a2e1-736f51a6aec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:11.069645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc52499-a10a-434b-a2e1-736f51a6aec3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:11.070620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc52499-a10a-434b-a2e1-736f51a6aec3 None admin] RBAC: Adding query filter params (interface=public, service_id=0dfa76016c9544d1bdb076c2429fea3a, region_id=RegionOne) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:11.071512 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc52499-a10a-434b-a2e1-736f51a6aec3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:11.073342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc52499-a10a-434b-a2e1-736f51a6aec3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:11.080604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 466/943] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 23 16:13:10 2022] GET /identity/v3/endpoints?service_id=0dfa76016c9544d1bdb076c2429fea3a&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:11.087539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc52499-a10a-434b-a2e1-736f51a6aec3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:11.134076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492233e-136e-40e9-a7c4-a3c67adffb53 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:11.168673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5319db-de5f-449d-abbd-c9dbd03bccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:11.169235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5319db-de5f-449d-abbd-c9dbd03bccbd None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:11.169513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5319db-de5f-449d-abbd-c9dbd03bccbd None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:11.169786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5319db-de5f-449d-abbd-c9dbd03bccbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:11.184250 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5319db-de5f-449d-abbd-c9dbd03bccbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:11.185794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5319db-de5f-449d-abbd-c9dbd03bccbd None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:11.201552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-5f5319db-de5f-449d-abbd-c9dbd03bccbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:11.201552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:11.201552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:11.201552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:11.201552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:11.201552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:11.201552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:11.201552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:11.201552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:11.201552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:11.201552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:11.201552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:11.201552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:11.201552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:11.201552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:11.201552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:11.202614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:11.202614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:11.202614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:11.202614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:11.202614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:11.202614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:11.202614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:11.202614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:11.202614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:11.202614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:11.202614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:11.202614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:11.202614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:11.202614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:11.202614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:11.202614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:11.202614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:11.203515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:11.203515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:11.203515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:11.203515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 478/944] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:11.204687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a2584-9bc3-45aa-b4a8-50616e235364 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:11.205034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a2584-9bc3-45aa-b4a8-50616e235364 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:11.205376 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a2584-9bc3-45aa-b4a8-50616e235364 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:11.207146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 479/945] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:11.208428 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a2584-9bc3-45aa-b4a8-50616e235364 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:11.210136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc52499-a10a-434b-a2e1-736f51a6aec3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:11.249699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61be220-661a-446a-8eff-9643390df261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:11.250391 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61be220-661a-446a-8eff-9643390df261 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:11.250676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61be220-661a-446a-8eff-9643390df261 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:11.250954 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61be220-661a-446a-8eff-9643390df261 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:11.251565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61be220-661a-446a-8eff-9643390df261 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:11.252934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61be220-661a-446a-8eff-9643390df261 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:11.268008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 467/946] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 23 16:13:11 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:13:11.268008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edba5e-38f9-4194-a527-ffd9e224dfe7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:11.268008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edba5e-38f9-4194-a527-ffd9e224dfe7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:11.268008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edba5e-38f9-4194-a527-ffd9e224dfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:11.285269 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-15edba5e-38f9-4194-a527-ffd9e224dfe7 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:11.286969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-15edba5e-38f9-4194-a527-ffd9e224dfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:11.296790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:11.347077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a2584-9bc3-45aa-b4a8-50616e235364 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:11.364085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:11.390272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 468/947] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:11.393729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cd51d-dd0a-4c56-a8df-977f1a3d4d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:11.400899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cd51d-dd0a-4c56-a8df-977f1a3d4d92 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:11.400899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cd51d-dd0a-4c56-a8df-977f1a3d4d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:11.400899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cd51d-dd0a-4c56-a8df-977f1a3d4d92 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:11.400899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cd51d-dd0a-4c56-a8df-977f1a3d4d92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:11.400899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cd51d-dd0a-4c56-a8df-977f1a3d4d92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:11.400899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2cd51d-dd0a-4c56-a8df-977f1a3d4d92 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:11.414387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 480/948] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:11.420522 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edba5e-38f9-4194-a527-ffd9e224dfe7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:11.527063 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edba5e-38f9-4194-a527-ffd9e224dfe7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:11.563187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eab07-628e-4d80-afce-3fe2aeec93a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:11.563812 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eab07-628e-4d80-afce-3fe2aeec93a9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:11.564088 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eab07-628e-4d80-afce-3fe2aeec93a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:11.564358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eab07-628e-4d80-afce-3fe2aeec93a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:11.571797 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22eab07-628e-4d80-afce-3fe2aeec93a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:11.573223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22eab07-628e-4d80-afce-3fe2aeec93a9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:11.584321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-c22eab07-628e-4d80-afce-3fe2aeec93a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:11.584321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:11.584321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:11.584321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:11.584321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:11.584321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:11.584321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:11.584321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:11.584321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:11.584321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:11.584321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:11.584321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:11.584321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:13:11.584321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:13:11.584321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:13:11.585212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:13:11.585212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:11.585212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:11.585212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:11.585212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:11.585212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:11.585212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:11.585212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:11.585212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:11.585212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:11.585212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:11.585212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:11.585212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:11.585212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:11.585212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:11.585212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:11.585212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:11.586208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:13:11.586208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:13:11.586208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:13:11.586208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:13:11.586208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:13:11.586208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:13:11.586208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:11.586208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:11.590170 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 469/949] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:13:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:11.591682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cd51d-dd0a-4c56-a8df-977f1a3d4d92 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:11.661606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eab07-628e-4d80-afce-3fe2aeec93a9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:11.702081 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cd51d-dd0a-4c56-a8df-977f1a3d4d92 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:11.714355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:11.723011 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:11.742606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6287a-27b7-4cc5-b4f7-32e2bbe3e587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:11.743390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6287a-27b7-4cc5-b4f7-32e2bbe3e587 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:11.743767 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6287a-27b7-4cc5-b4f7-32e2bbe3e587 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:11.744137 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6287a-27b7-4cc5-b4f7-32e2bbe3e587 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:11.744933 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6287a-27b7-4cc5-b4f7-32e2bbe3e587 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:11.745341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6287a-27b7-4cc5-b4f7-32e2bbe3e587 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:11.746911 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6287a-27b7-4cc5-b4f7-32e2bbe3e587 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:11.759631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 481/950] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:13:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:11.771062 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6287a-27b7-4cc5-b4f7-32e2bbe3e587 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:11.775560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eab07-628e-4d80-afce-3fe2aeec93a9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:11.818781 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2992266-601e-4180-9bbc-6d20b8c651eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:11.819398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2992266-601e-4180-9bbc-6d20b8c651eb None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:11.819682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2992266-601e-4180-9bbc-6d20b8c651eb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:11.820078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2992266-601e-4180-9bbc-6d20b8c651eb None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:11.821300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2992266-601e-4180-9bbc-6d20b8c651eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:11.822889 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2992266-601e-4180-9bbc-6d20b8c651eb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:11.826769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: WARNING keystone.server.flask.common [None req-f2992266-601e-4180-9bbc-6d20b8c651eb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 16:13:11.852162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.sql.core [None req-f2992266-601e-4180-9bbc-6d20b8c651eb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 16:13:11.852162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 16:13:11.852162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [parameters: {'id': '42a9e25324244dfc94933570e8313c58', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 16:13:11.852162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81603) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 16:13:11.869756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-f2992266-601e-4180-9bbc-6d20b8c651eb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 42a9e25324244dfc94933570e8313c58.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 42a9e25324244dfc94933570e8313c58. Aug 23 16:13:11.869756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:11.869756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 16:13:11.869756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 16:13:11.869756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 16:13:11.869756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 16:13:11.869756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 16:13:11.869756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 16:13:11.869756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 16:13:11.869756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application conn.query(q) Aug 23 16:13:11.869756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 16:13:11.869756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 16:13:11.869756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 16:13:11.870703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application result.read() Aug 23 16:13:11.870703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 16:13:11.870703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 16:13:11.870703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 16:13:11.870703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 16:13:11.870703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 16:13:11.870703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 16:13:11.870703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 16:13:11.870703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 16:13:11.870703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 16:13:11.870703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:11.870703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 16:13:11.870703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:11.870703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:11.870703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 16:13:11.870703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 16:13:11.870703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 23 16:13:11.870703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 23 16:13:11.871675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 16:13:11.871675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application next(self.gen) Aug 23 16:13:11.871675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 16:13:11.871675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application yield resource Aug 23 16:13:11.871675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 16:13:11.871675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application next(self.gen) Aug 23 16:13:11.871675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 16:13:11.871675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 16:13:11.871675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 16:13:11.871675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 16:13:11.871675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 16:13:11.871675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise self.value Aug 23 16:13:11.871675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 16:13:11.871675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 16:13:11.871675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 16:13:11.871675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application session.commit() Aug 23 16:13:11.871675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 16:13:11.872560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 16:13:11.872560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 16:13:11.872560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 16:13:11.872560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 16:13:11.872560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.session.flush() Aug 23 16:13:11.872560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 16:13:11.872560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 16:13:11.872560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 16:13:11.872560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 16:13:11.872560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 16:13:11.872560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application compat.raise_( Aug 23 16:13:11.872560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 16:13:11.872560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception Aug 23 16:13:11.872560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 16:13:11.872560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 16:13:11.872560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 16:13:11.872560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 16:13:11.874160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 16:13:11.874160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 16:13:11.874160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 16:13:11.874160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 16:13:11.874160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 16:13:11.874160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 16:13:11.874160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 16:13:11.874160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 16:13:11.874160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 16:13:11.874160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 16:13:11.874160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 16:13:11.874160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 16:13:11.874160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 16:13:11.874160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 16:13:11.874160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 16:13:11.874946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 16:13:11.874946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 16:13:11.874946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception Aug 23 16:13:11.874946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 16:13:11.874946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 16:13:11.874946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 16:13:11.874946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 16:13:11.874946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 16:13:11.874946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 16:13:11.874946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 16:13:11.874946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application conn.query(q) Aug 23 16:13:11.874946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 16:13:11.874946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 16:13:11.874946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 16:13:11.874946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application result.read() Aug 23 16:13:11.874946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 16:13:11.874946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 16:13:11.876989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 16:13:11.876989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 16:13:11.876989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 16:13:11.876989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 16:13:11.876989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 16:13:11.876989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 16:13:11.876989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 16:13:11.876989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 16:13:11.876989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [parameters: {'id': '42a9e25324244dfc94933570e8313c58', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 16:13:11.876989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 16:13:11.876989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:11.876989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:11.876989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:11.876989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:11.876989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 23 16:13:11.879032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 23 16:13:11.879032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 16:13:11.879032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 16:13:11.879032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 23 16:13:11.879032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:11.879032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:11.879032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:11.879032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:11.879032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:11.879032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:11.879032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:11.879032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:11.879032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:11.879032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:11.879032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:11.879032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:11.879032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:11.881178 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:11.881178 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 23 16:13:11.881178 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 23 16:13:11.881178 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:11.881178 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:11.881178 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 23 16:13:11.881178 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 23 16:13:11.881178 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 42a9e25324244dfc94933570e8313c58. Aug 23 16:13:11.881178 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:11.881178 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 470/951] 10.222.0.16 () {60 vars in 1140 bytes} [Tue Aug 23 16:13:11 2022] POST /identity/v3/projects => generated 262 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:11.881178 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2992266-601e-4180-9bbc-6d20b8c651eb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:11.902869 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6287a-27b7-4cc5-b4f7-32e2bbe3e587 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:11.939655 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561d20a-ff87-4736-9566-d0ad89d92097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:11.940735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561d20a-ff87-4736-9566-d0ad89d92097 None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:11.941235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561d20a-ff87-4736-9566-d0ad89d92097 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:11.941703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561d20a-ff87-4736-9566-d0ad89d92097 None admin] PATH_INFO: `/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/5fe3a02c2bc247efa354ca5bac39ec4e/roles/361e9c2a98ae4a7f925cd3ec46baf425` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:11.944249 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561d20a-ff87-4736-9566-d0ad89d92097 None admin] RBAC: Authorizing `identity:create_grant(project_id=15a0439c9dd3406f81e2740fe775782b, user_id=5fe3a02c2bc247efa354ca5bac39ec4e, role_id=361e9c2a98ae4a7f925cd3ec46baf425)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:11.946557 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561d20a-ff87-4736-9566-d0ad89d92097 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:11.970484 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 482/952] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:13:11 2022] PUT /identity/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/5fe3a02c2bc247efa354ca5bac39ec4e/roles/361e9c2a98ae4a7f925cd3ec46baf425 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:13:11.992559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2992266-601e-4180-9bbc-6d20b8c651eb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:11.994458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:12.042810 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129942f-d751-47e1-a600-bd8fb45f09aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:12.043468 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129942f-d751-47e1-a600-bd8fb45f09aa None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:12.043752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129942f-d751-47e1-a600-bd8fb45f09aa None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:12.044039 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129942f-d751-47e1-a600-bd8fb45f09aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:12.051691 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129942f-d751-47e1-a600-bd8fb45f09aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:12.053367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129942f-d751-47e1-a600-bd8fb45f09aa None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:12.066382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-4129942f-d751-47e1-a600-bd8fb45f09aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:12.066382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:12.066382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:12.066382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:12.066382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:12.066382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:12.066382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:12.066382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:12.066382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:12.066382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:12.066382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:12.066382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:12.066382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:13:12.066382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:13:12.066382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:13:12.067358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:13:12.067358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:12.067358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:12.067358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:12.067358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:12.067358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:12.067358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:12.067358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:12.067358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:12.067358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:12.067358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:12.067358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:12.067358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:12.067358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:12.067358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:12.067358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:12.067358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:12.069147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:13:12.069147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:13:12.069147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:13:12.069147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:13:12.069147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:13:12.069147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:13:12.069147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:12.069147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:12.069147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 471/953] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:13:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:12.074519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561d20a-ff87-4736-9566-d0ad89d92097 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:12.122385 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:12.190782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561d20a-ff87-4736-9566-d0ad89d92097 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:12.227492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849537a-908a-4f37-a1ce-7c3ba856064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:12.227883 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849537a-908a-4f37-a1ce-7c3ba856064f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:12.228162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849537a-908a-4f37-a1ce-7c3ba856064f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:12.228435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849537a-908a-4f37-a1ce-7c3ba856064f None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:12.229102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849537a-908a-4f37-a1ce-7c3ba856064f None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:12.229400 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849537a-908a-4f37-a1ce-7c3ba856064f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:12.230995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849537a-908a-4f37-a1ce-7c3ba856064f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:12.251266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a775e-e88a-4b04-807e-3eba36970799 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:12.251584 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a775e-e88a-4b04-807e-3eba36970799 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:12.258122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a775e-e88a-4b04-807e-3eba36970799 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:12.258354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 483/954] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 16:13:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:12.258523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 472/955] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:12.263152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddd289-66c6-4c90-a20b-1b59fa084e63 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:12.263440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddd289-66c6-4c90-a20b-1b59fa084e63 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:12.263711 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddd289-66c6-4c90-a20b-1b59fa084e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:12.284835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-8bddd289-66c6-4c90-a20b-1b59fa084e63 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:12.286059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8bddd289-66c6-4c90-a20b-1b59fa084e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:12.371816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 484/956] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:12.646864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a775e-e88a-4b04-807e-3eba36970799 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:12.755518 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a775e-e88a-4b04-807e-3eba36970799 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:12.791687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60e68b-0840-4366-90a9-2ab1175a5601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:12.792676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60e68b-0840-4366-90a9-2ab1175a5601 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:12.793163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60e68b-0840-4366-90a9-2ab1175a5601 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:12.793634 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60e68b-0840-4366-90a9-2ab1175a5601 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:12.794550 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60e68b-0840-4366-90a9-2ab1175a5601 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:12.796130 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60e68b-0840-4366-90a9-2ab1175a5601 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:12.813514 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 473/957] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 16:13:12 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:13:13.272748 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab899e-065e-41f1-854a-5f4d19e2bd6a None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:13.273809 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab899e-065e-41f1-854a-5f4d19e2bd6a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:13.274316 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab899e-065e-41f1-854a-5f4d19e2bd6a None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:13.276207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 485/958] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:13.283987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0978aa2-e5bd-4270-b291-b39f165bac2d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:13.284528 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0978aa2-e5bd-4270-b291-b39f165bac2d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:13.285024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0978aa2-e5bd-4270-b291-b39f165bac2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:13.304727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e0978aa2-e5bd-4270-b291-b39f165bac2d None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:13.306622 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e0978aa2-e5bd-4270-b291-b39f165bac2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:13.324933 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:13.385810 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 474/959] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:13 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:13:13.653815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab899e-065e-41f1-854a-5f4d19e2bd6a None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:13.684425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:13.763497 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab899e-065e-41f1-854a-5f4d19e2bd6a None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:13.799944 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4248d12-1b85-47f0-a48d-16a47047deaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:13.800957 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4248d12-1b85-47f0-a48d-16a47047deaf None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:13.801444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4248d12-1b85-47f0-a48d-16a47047deaf None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:13.801909 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4248d12-1b85-47f0-a48d-16a47047deaf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:13.802709 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4248d12-1b85-47f0-a48d-16a47047deaf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:13.804905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4248d12-1b85-47f0-a48d-16a47047deaf None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:13.813939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-e4248d12-1b85-47f0-a48d-16a47047deaf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:13:13.813939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:13.813939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:13:13.813939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:13:13.813939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:13:13.813939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:13:13.813939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:13:13.813939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:13.813939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:13:13.813939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:13.813939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:13.813939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:13.813939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:13.813939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:13.813939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:13.813939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:13.813939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:13.815043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:13.815043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:13.815043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:13.815043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:13.815043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:13.815043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:13.815043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:13:13.815043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:13:13.815043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:13:13.815043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:13:13.815043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:13.815043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:13.815043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:13.815043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:13.815043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:13.815043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:13.815918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:13.815918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:13.815918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:13.815918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:13.815918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:13.815918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:13.815918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:13.815918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:13.815918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:13.815918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:13.815918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:13:13.815918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:13.815918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:13:13.815918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:13.822161 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 486/960] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 16:13:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:13.825316 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0978aa2-e5bd-4270-b291-b39f165bac2d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:13.930896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0978aa2-e5bd-4270-b291-b39f165bac2d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:13.966417 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8d027-ad89-420e-b95a-36f1b8e0bd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:13.967436 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8d027-ad89-420e-b95a-36f1b8e0bd64 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:13.967914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8d027-ad89-420e-b95a-36f1b8e0bd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:13.968406 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8d027-ad89-420e-b95a-36f1b8e0bd64 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:13.969286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8d027-ad89-420e-b95a-36f1b8e0bd64 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:13.969800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8d027-ad89-420e-b95a-36f1b8e0bd64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:13.971441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8d027-ad89-420e-b95a-36f1b8e0bd64 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:13.980968 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 475/961] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 23 16:13:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:13.986835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4248d12-1b85-47f0-a48d-16a47047deaf None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:14.026583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3bfd0-519f-439c-8443-793621860cc0 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:14.026898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3bfd0-519f-439c-8443-793621860cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:14.027143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3bfd0-519f-439c-8443-793621860cc0 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:14.028737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 476/962] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:13:14.034486 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6311e-4dcb-4047-87e2-8d51eb8099b7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:14.034767 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6311e-4dcb-4047-87e2-8d51eb8099b7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:14.035040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6311e-4dcb-4047-87e2-8d51eb8099b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:14.057381 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-bcd6311e-4dcb-4047-87e2-8d51eb8099b7 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:14.058603 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bcd6311e-4dcb-4047-87e2-8d51eb8099b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:14.070761 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:14.091337 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:14.102385 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4248d12-1b85-47f0-a48d-16a47047deaf None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:14.133236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 477/963] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:13:14.146085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e22f2-6c1f-4be7-afe3-4d82779f6350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:14.146085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e22f2-6c1f-4be7-afe3-4d82779f6350 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:14.146085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e22f2-6c1f-4be7-afe3-4d82779f6350 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:14.146085 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e22f2-6c1f-4be7-afe3-4d82779f6350 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:14.146490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e22f2-6c1f-4be7-afe3-4d82779f6350 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:14.146490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e22f2-6c1f-4be7-afe3-4d82779f6350 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:14.147390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e22f2-6c1f-4be7-afe3-4d82779f6350 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:14.157914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 487/964] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 23 16:13:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:14.159507 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6311e-4dcb-4047-87e2-8d51eb8099b7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:14.267467 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6311e-4dcb-4047-87e2-8d51eb8099b7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:14.302821 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2617d9-641f-4209-bbb3-9d1e8edb20a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:14.303426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2617d9-641f-4209-bbb3-9d1e8edb20a3 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:14.303704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2617d9-641f-4209-bbb3-9d1e8edb20a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:14.303972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2617d9-641f-4209-bbb3-9d1e8edb20a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:14.305298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2617d9-641f-4209-bbb3-9d1e8edb20a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:14.306975 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2617d9-641f-4209-bbb3-9d1e8edb20a3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:14.325571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:14.338455 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 478/965] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 16:13:14 2022] POST /identity/v3/endpoints => generated 349 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:13:14.363197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3b10a-eaed-437a-957e-8539cdc404d5 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:14.363725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3b10a-eaed-437a-957e-8539cdc404d5 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:14.363832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3b10a-eaed-437a-957e-8539cdc404d5 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:14.365461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 488/966] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:14.371936 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd3fd6-5907-4f58-a4f4-38b1c2d5867b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:14.372225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd3fd6-5907-4f58-a4f4-38b1c2d5867b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:14.372499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd3fd6-5907-4f58-a4f4-38b1c2d5867b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:14.393022 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d5fd3fd6-5907-4f58-a4f4-38b1c2d5867b None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:14.394369 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d5fd3fd6-5907-4f58-a4f4-38b1c2d5867b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:14.419154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3b10a-eaed-437a-957e-8539cdc404d5 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:14.496252 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 479/967] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:14.540582 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3b10a-eaed-437a-957e-8539cdc404d5 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:14.577952 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47dbac-1344-4138-8785-ea0694127835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:14.578612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47dbac-1344-4138-8785-ea0694127835 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:14.578895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47dbac-1344-4138-8785-ea0694127835 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:14.579166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47dbac-1344-4138-8785-ea0694127835 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:14.590346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47dbac-1344-4138-8785-ea0694127835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:13:14.595034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-2f47dbac-1344-4138-8785-ea0694127835 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:13:14.595034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:14.595034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:14.595034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:14.595034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:14.595034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:14.595034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:14.595034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:14.595034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:14.595034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:14.595034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:14.595034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:14.595034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:13:14.595034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:13:14.595034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:13:14.595034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:13:14.595981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:13:14.595981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:13:14.595981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:13:14.595981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:13:14.595981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:14.595981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:14.595981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:14.595981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:14.595981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:14.595981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:14.595981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:14.595981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:14.595981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:14.595981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:14.595981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:14.595981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:14.596861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:14.596861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:14.596861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:14.596861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:14.596861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:13:14.596861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:13:14.596861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:13:14.596861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:13:14.596861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:13:14.596861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:13:14.596861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:13:14.596861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:14.596861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 489/968] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 23 16:13:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:14.603146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd3fd6-5907-4f58-a4f4-38b1c2d5867b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:14.709255 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd3fd6-5907-4f58-a4f4-38b1c2d5867b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:14.734909 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:14.747595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1542417-35c3-4d10-bcad-ea3274732578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:14.748144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1542417-35c3-4d10-bcad-ea3274732578 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:14.748424 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1542417-35c3-4d10-bcad-ea3274732578 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:14.748696 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1542417-35c3-4d10-bcad-ea3274732578 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:14.749362 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1542417-35c3-4d10-bcad-ea3274732578 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:14.749664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1542417-35c3-4d10-bcad-ea3274732578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:14.751069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1542417-35c3-4d10-bcad-ea3274732578 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:14.760776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 480/969] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 23 16:13:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:14.766458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47dbac-1344-4138-8785-ea0694127835 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:14.786845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:14.811089 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1542417-35c3-4d10-bcad-ea3274732578 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:14.891443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47dbac-1344-4138-8785-ea0694127835 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:14.923308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1542417-35c3-4d10-bcad-ea3274732578 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:14.928711 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd94ef8-0fbe-4306-b35d-2cc71f17fe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:14.929643 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd94ef8-0fbe-4306-b35d-2cc71f17fe46 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:14.930179 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd94ef8-0fbe-4306-b35d-2cc71f17fe46 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:14.930658 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd94ef8-0fbe-4306-b35d-2cc71f17fe46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:14.943290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd94ef8-0fbe-4306-b35d-2cc71f17fe46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:14.944892 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd94ef8-0fbe-4306-b35d-2cc71f17fe46 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:14.957742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3149e92-c181-477e-8a05-6f73c3845a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:14.958388 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3149e92-c181-477e-8a05-6f73c3845a1b None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:14.958670 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3149e92-c181-477e-8a05-6f73c3845a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:14.958946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3149e92-c181-477e-8a05-6f73c3845a1b None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:14.959595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3149e92-c181-477e-8a05-6f73c3845a1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:14.961142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-9bd94ef8-0fbe-4306-b35d-2cc71f17fe46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:14.961142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:14.961142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:14.961142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:14.961142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:14.961142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:14.961142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:14.961142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:14.961142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:14.961142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:14.961142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:14.961142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:14.961142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:14.961142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:14.961142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:14.961142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:14.962373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:14.962373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:14.962373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:14.962373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:14.962373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:14.962373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:14.962373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:14.962373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:14.962373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:14.962373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:14.962373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:14.962373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:14.962373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:14.962373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:14.962373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:14.962373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:14.962373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:14.963435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:14.963435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:14.963435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:14.963646 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3149e92-c181-477e-8a05-6f73c3845a1b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:14.965229 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 490/970] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:14.966682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e360489-4143-4086-8ad9-7c146242464b None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:14.967163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e360489-4143-4086-8ad9-7c146242464b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:14.967575 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e360489-4143-4086-8ad9-7c146242464b None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:14.969169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 491/971] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:14.970538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e360489-4143-4086-8ad9-7c146242464b None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:14.980376 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.sql.core [None req-e3149e92-c181-477e-8a05-6f73c3845a1b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 16:13:14.980376 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 16:13:14.980376 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [parameters: {'user_id': '2a7962874b79424b97a3998f448099c4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 16:13:14.980376 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81603) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 16:13:14.987333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e3149e92-c181-477e-8a05-6f73c3845a1b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 16:13:14.987333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:14.987333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 16:13:14.987333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 16:13:14.987333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 16:13:14.987333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 16:13:14.987333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 16:13:14.987333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 16:13:14.987333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 16:13:14.987333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application conn.query(q) Aug 23 16:13:14.987333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 16:13:14.987333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 16:13:14.987333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 16:13:14.987333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application result.read() Aug 23 16:13:14.987333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 16:13:14.988201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 16:13:14.988201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 16:13:14.988201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 16:13:14.988201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 16:13:14.988201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 16:13:14.988201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 16:13:14.988201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 16:13:14.988201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 16:13:14.988201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:14.988201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 16:13:14.988201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:14.988201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:14.988201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 16:13:14.988201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 16:13:14.988201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 23 16:13:14.988201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 23 16:13:14.988201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 16:13:14.988201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application next(self.gen) Aug 23 16:13:14.989169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 16:13:14.989169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application yield resource Aug 23 16:13:14.989169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 16:13:14.989169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application next(self.gen) Aug 23 16:13:14.989169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 16:13:14.989169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 16:13:14.989169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 16:13:14.989169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 16:13:14.989169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 16:13:14.989169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise self.value Aug 23 16:13:14.989169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 16:13:14.989169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 16:13:14.989169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 16:13:14.989169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application session.commit() Aug 23 16:13:14.989169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 16:13:14.989169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 16:13:14.989169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 16:13:14.990181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 16:13:14.990181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 16:13:14.990181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.session.flush() Aug 23 16:13:14.990181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 16:13:14.990181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 16:13:14.990181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 16:13:14.990181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 16:13:14.990181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 16:13:14.990181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application compat.raise_( Aug 23 16:13:14.990181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 16:13:14.990181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception Aug 23 16:13:14.990181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 16:13:14.990181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 16:13:14.990181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 16:13:14.990181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 16:13:14.990181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 16:13:14.990181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 16:13:14.991097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 16:13:14.991097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 16:13:14.991097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 16:13:14.991097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 23 16:13:14.991097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 16:13:14.991097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 16:13:14.991097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 16:13:14.991097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 16:13:14.991097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 16:13:14.991097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 16:13:14.991097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 16:13:14.991097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 16:13:14.991097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 16:13:14.991097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 16:13:14.991097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 16:13:14.991097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception Aug 23 16:13:14.991999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 16:13:14.991999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 16:13:14.991999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 16:13:14.991999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 16:13:14.991999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 16:13:14.991999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 16:13:14.991999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 16:13:14.991999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application conn.query(q) Aug 23 16:13:14.991999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 16:13:14.991999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 16:13:14.991999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 16:13:14.991999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application result.read() Aug 23 16:13:14.991999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 16:13:14.991999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 16:13:14.991999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 16:13:14.991999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 16:13:14.992986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 16:13:14.992986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 16:13:14.992986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 16:13:14.992986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 16:13:14.992986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 16:13:14.992986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 16:13:14.992986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [parameters: {'user_id': '2a7962874b79424b97a3998f448099c4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 16:13:14.992986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 16:13:14.992986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:14.992986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:14.992986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:14.992986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:14.992986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:14.992986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:14.992986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:14.995286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:14.995286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:14.995286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:14.995286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:14.995286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:14.995286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:14.995286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:14.995286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 23 16:13:14.995286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 23 16:13:14.995286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:14.995286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:14.995286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:13:14.995286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:14.995286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:13:14.995286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:14.995286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 23 16:13:14.995286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 23 16:13:14.997493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 23 16:13:14.997493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 23 16:13:14.997493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 16:13:14.997493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 16:13:14.997493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 16:13:14.997493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:14.997493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 481/972] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Aug 23 16:13:14 2022] POST /identity/v3/users => generated 160 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:14.997493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da014b8-22eb-40f7-9c13-c890e25be35e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:14.997493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da014b8-22eb-40f7-9c13-c890e25be35e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:14.997493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da014b8-22eb-40f7-9c13-c890e25be35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:15.009464 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2da014b8-22eb-40f7-9c13-c890e25be35e None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:15.010779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2da014b8-22eb-40f7-9c13-c890e25be35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:15.059716 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:15.061112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:15.086795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 482/973] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:15.087585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da014b8-22eb-40f7-9c13-c890e25be35e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:15.125412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e360489-4143-4086-8ad9-7c146242464b None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:15.181793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dba709-d92d-4c85-87f1-5a769abc693f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:15.183103 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dba709-d92d-4c85-87f1-5a769abc693f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:15.183567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dba709-d92d-4c85-87f1-5a769abc693f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:15.184039 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dba709-d92d-4c85-87f1-5a769abc693f None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:15.184864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dba709-d92d-4c85-87f1-5a769abc693f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:15.185357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dba709-d92d-4c85-87f1-5a769abc693f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:15.187788 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dba709-d92d-4c85-87f1-5a769abc693f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:15.198966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da014b8-22eb-40f7-9c13-c890e25be35e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:15.208749 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 492/974] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:15.210297 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dba709-d92d-4c85-87f1-5a769abc693f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:15.247044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425c45d-ab73-4a2b-b942-6e89e1d9cdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:15.248880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425c45d-ab73-4a2b-b942-6e89e1d9cdc6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:15.249349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425c45d-ab73-4a2b-b942-6e89e1d9cdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:15.249823 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425c45d-ab73-4a2b-b942-6e89e1d9cdc6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:15.258522 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425c45d-ab73-4a2b-b942-6e89e1d9cdc6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:15.261033 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425c45d-ab73-4a2b-b942-6e89e1d9cdc6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:15.276918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5425c45d-ab73-4a2b-b942-6e89e1d9cdc6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:13:15.276918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:15.276918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:15.276918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:15.276918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:15.276918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:15.276918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:15.276918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:15.276918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:15.276918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:15.276918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:15.276918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:15.276918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:13:15.276918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:13:15.276918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:13:15.276918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:13:15.277858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:15.277858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:15.277858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:13:15.277858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:15.277858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:13:15.277858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:15.277858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:15.277858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:15.277858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:15.277858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:15.277858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:15.277858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:15.277858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:15.277858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:15.277858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:15.277858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:15.277858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:15.277858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:15.278840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:15.278840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:15.278840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:13:15.278840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:13:15.278840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:13:15.278840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:13:15.278840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:13:15.278840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:13:15.278840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 16:13:15.278840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:15.280097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 483/975] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:13:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:15.286123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425c45d-ab73-4a2b-b942-6e89e1d9cdc6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:15.330214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dba709-d92d-4c85-87f1-5a769abc693f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:15.344601 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:15.363560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:15.373128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d143ff3-d9cd-49fa-b6d2-420fd6f42c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:15.373777 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d143ff3-d9cd-49fa-b6d2-420fd6f42c7f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:15.374119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d143ff3-d9cd-49fa-b6d2-420fd6f42c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:15.374419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d143ff3-d9cd-49fa-b6d2-420fd6f42c7f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:15.381478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d143ff3-d9cd-49fa-b6d2-420fd6f42c7f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:15.383779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d143ff3-d9cd-49fa-b6d2-420fd6f42c7f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:15.396631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-9d143ff3-d9cd-49fa-b6d2-420fd6f42c7f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:13:15.396631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:15.396631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:15.396631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:15.396631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:15.396631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:15.396631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:15.396631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:15.396631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:15.396631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:15.396631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:15.396631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:15.396631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:13:15.396631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:13:15.396631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:13:15.396631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:13:15.397596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:15.397596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:15.397596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:13:15.397596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:15.397596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:13:15.397596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:15.397596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:15.397596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:15.397596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:15.397596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:15.397596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:15.397596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:15.397596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:15.397596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:15.397596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:15.397596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:15.397596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:15.397596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:15.403095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:15.403095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:15.403095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:13:15.403095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:13:15.403095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:13:15.403095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:13:15.403095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:13:15.403095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:13:15.403095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 16:13:15.403095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:15.403095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 493/976] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 23 16:13:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:15.403095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d143ff3-d9cd-49fa-b6d2-420fd6f42c7f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:15.431267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425c45d-ab73-4a2b-b942-6e89e1d9cdc6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:15.478917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea67f5d-3182-4a6d-ae33-24cbcf3e2116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:15.479536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea67f5d-3182-4a6d-ae33-24cbcf3e2116 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:15.479868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea67f5d-3182-4a6d-ae33-24cbcf3e2116 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:15.480146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea67f5d-3182-4a6d-ae33-24cbcf3e2116 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:15.480846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea67f5d-3182-4a6d-ae33-24cbcf3e2116 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:15.481150 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea67f5d-3182-4a6d-ae33-24cbcf3e2116 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:15.482633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea67f5d-3182-4a6d-ae33-24cbcf3e2116 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:15.507577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d143ff3-d9cd-49fa-b6d2-420fd6f42c7f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:15.525266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 484/977] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 16:13:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:15.532057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea67f5d-3182-4a6d-ae33-24cbcf3e2116 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:15.550412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b52df8-77e8-4c02-8ce9-545a4b7ca5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:15.551071 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b52df8-77e8-4c02-8ce9-545a4b7ca5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:15.551353 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b52df8-77e8-4c02-8ce9-545a4b7ca5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:15.551633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b52df8-77e8-4c02-8ce9-545a4b7ca5f5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:15.552221 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b52df8-77e8-4c02-8ce9-545a4b7ca5f5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:15.554450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b52df8-77e8-4c02-8ce9-545a4b7ca5f5 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:15.565480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-03b52df8-77e8-4c02-8ce9-545a4b7ca5f5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:13:15.565480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:15.565480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:13:15.565480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:13:15.565480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:13:15.565480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:13:15.565480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:13:15.565480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:15.565480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:13:15.565480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:15.565480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:15.565480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:15.565480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:15.565480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:15.565480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:15.565480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:15.565480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:15.566612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:15.566612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:15.566612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:15.566612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:15.566612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:15.566612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:15.566612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:13:15.566612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:13:15.566612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:13:15.566612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:13:15.566612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:15.566612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:15.566612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:15.566612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:15.566612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:15.566612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:15.572970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:15.572970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:15.572970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:15.572970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:15.572970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:15.572970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:15.572970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:15.572970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:15.572970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:15.572970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:15.572970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:13:15.572970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:15.572970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:13:15.572970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:15.572970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 494/978] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:13:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:15.574279 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b52df8-77e8-4c02-8ce9-545a4b7ca5f5 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:15.648721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:15.674667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:15.684949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea67f5d-3182-4a6d-ae33-24cbcf3e2116 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:15.720072 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b52df8-77e8-4c02-8ce9-545a4b7ca5f5 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:15.736455 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2d24c-38d6-40ea-948b-172750170630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:15.737077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2d24c-38d6-40ea-948b-172750170630 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:15.737356 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2d24c-38d6-40ea-948b-172750170630 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:15.737629 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2d24c-38d6-40ea-948b-172750170630 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:15.740997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2d24c-38d6-40ea-948b-172750170630 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:15.740997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2d24c-38d6-40ea-948b-172750170630 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:15.740997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2d24c-38d6-40ea-948b-172750170630 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:15.764717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 485/979] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 23 16:13:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:15.767513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fabd9-7c18-4b3b-b597-36c4392397f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:15.768127 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fabd9-7c18-4b3b-b597-36c4392397f1 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:15.768409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fabd9-7c18-4b3b-b597-36c4392397f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:15.768680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fabd9-7c18-4b3b-b597-36c4392397f1 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:15.769735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63fabd9-7c18-4b3b-b597-36c4392397f1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:15.769735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63fabd9-7c18-4b3b-b597-36c4392397f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:15.770100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2d24c-38d6-40ea-948b-172750170630 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:15.771006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63fabd9-7c18-4b3b-b597-36c4392397f1 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:15.778154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 495/980] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 16:13:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:15.784108 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fabd9-7c18-4b3b-b597-36c4392397f1 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:15.892378 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2d24c-38d6-40ea-948b-172750170630 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:15.900608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fabd9-7c18-4b3b-b597-36c4392397f1 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:15.918573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:15.929808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd1204-a9c3-4da4-8927-bf77e2b279d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:15.930465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd1204-a9c3-4da4-8927-bf77e2b279d4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:15.930978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd1204-a9c3-4da4-8927-bf77e2b279d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:15.931096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd1204-a9c3-4da4-8927-bf77e2b279d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:15.940007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3f0e4-195e-45e5-abab-b497d5a709b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:15.940720 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3f0e4-195e-45e5-abab-b497d5a709b3 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:15.941125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3f0e4-195e-45e5-abab-b497d5a709b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:15.941849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3f0e4-195e-45e5-abab-b497d5a709b3 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:15.942617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3f0e4-195e-45e5-abab-b497d5a709b3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:15.943319 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3f0e4-195e-45e5-abab-b497d5a709b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:15.945354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3f0e4-195e-45e5-abab-b497d5a709b3 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:15.955170 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 496/981] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 16:13:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:15.956172 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3f0e4-195e-45e5-abab-b497d5a709b3 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:15.963107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:16.011637 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd1204-a9c3-4da4-8927-bf77e2b279d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:16.013068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd1204-a9c3-4da4-8927-bf77e2b279d4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:16.069298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3f0e4-195e-45e5-abab-b497d5a709b3 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:16.112423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb3d04-743e-49c2-a540-9c60786445c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:16.113212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb3d04-743e-49c2-a540-9c60786445c0 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:16.113588 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb3d04-743e-49c2-a540-9c60786445c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:16.114096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb3d04-743e-49c2-a540-9c60786445c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:16.115006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb3d04-743e-49c2-a540-9c60786445c0 None admin] RBAC: Adding query filter params (interface=public, service_id=6e83713be153448e8d857433a9bd580d, region_id=RegionOne) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:16.115407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb3d04-743e-49c2-a540-9c60786445c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:16.117785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb3d04-743e-49c2-a540-9c60786445c0 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:16.129208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 486/982] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:13:15 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 16:13:16.129381 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 497/983] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 23 16:13:15 2022] GET /identity/v3/endpoints?service_id=6e83713be153448e8d857433a9bd580d&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:16.129475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd1204-a9c3-4da4-8927-bf77e2b279d4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:16.130245 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb3d04-743e-49c2-a540-9c60786445c0 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:16.183431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:16.191092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:16.238394 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd1204-a9c3-4da4-8927-bf77e2b279d4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:16.245581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb3d04-743e-49c2-a540-9c60786445c0 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:16.275354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8516cbd-defe-4a41-a5e9-88b353f5cfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:16.275974 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8516cbd-defe-4a41-a5e9-88b353f5cfd4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:16.276259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8516cbd-defe-4a41-a5e9-88b353f5cfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:16.276536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8516cbd-defe-4a41-a5e9-88b353f5cfd4 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:16.277146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8516cbd-defe-4a41-a5e9-88b353f5cfd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:16.278535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8516cbd-defe-4a41-a5e9-88b353f5cfd4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:16.283895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21563a-a534-4057-b4e0-b73d73c644d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:16.284522 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21563a-a534-4057-b4e0-b73d73c644d1 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:16.284804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21563a-a534-4057-b4e0-b73d73c644d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:16.285078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21563a-a534-4057-b4e0-b73d73c644d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:16.294358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 487/984] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 23 16:13:16 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:13:16.306130 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21563a-a534-4057-b4e0-b73d73c644d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:16.307612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21563a-a534-4057-b4e0-b73d73c644d1 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:16.324258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-6e21563a-a534-4057-b4e0-b73d73c644d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:16.324258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:16.324258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:16.324258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:16.324258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:16.324258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:16.324258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:16.324258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:16.324258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:16.324258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:16.324258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:16.324258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:16.324258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:16.324258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:16.324258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:16.324258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:16.325277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:16.325277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:16.325277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:16.325277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:16.325277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:16.325277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:16.325277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:16.325277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:16.325277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:16.325277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:16.325277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:16.325277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:16.325277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:16.325277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:16.325277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:16.325277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:16.325277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:16.326616 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:16.326616 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:16.326616 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:16.330039 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 498/985] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:16.331452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8516cbd-defe-4a41-a5e9-88b353f5cfd4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:16.402757 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6d4ff-c86b-42d2-a6f6-e19127a3f950 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:16.403297 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6d4ff-c86b-42d2-a6f6-e19127a3f950 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:16.403468 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6d4ff-c86b-42d2-a6f6-e19127a3f950 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:16.404851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 499/986] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:13:16.411107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b481d8-928d-45eb-bd14-4101a3ec7b6d None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:16.411395 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b481d8-928d-45eb-bd14-4101a3ec7b6d None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:16.411676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b481d8-928d-45eb-bd14-4101a3ec7b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:16.431161 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-02b481d8-928d-45eb-bd14-4101a3ec7b6d None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:16.432398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-02b481d8-928d-45eb-bd14-4101a3ec7b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:16.447905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8516cbd-defe-4a41-a5e9-88b353f5cfd4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:16.467602 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:16.487429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44752903-4c7d-4e3e-8e35-80df761de101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:16.488034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44752903-4c7d-4e3e-8e35-80df761de101 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:16.488308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44752903-4c7d-4e3e-8e35-80df761de101 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:16.488581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44752903-4c7d-4e3e-8e35-80df761de101 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:16.489221 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44752903-4c7d-4e3e-8e35-80df761de101 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:16.489520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44752903-4c7d-4e3e-8e35-80df761de101 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:16.490929 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44752903-4c7d-4e3e-8e35-80df761de101 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:16.503569 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 488/987] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:16.509156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44752903-4c7d-4e3e-8e35-80df761de101 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:16.518986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 500/988] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:13:16.615305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44752903-4c7d-4e3e-8e35-80df761de101 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:16.649047 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a94c2-e7a3-41ad-9434-70b5b03f614c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:16.649679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a94c2-e7a3-41ad-9434-70b5b03f614c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:16.649961 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a94c2-e7a3-41ad-9434-70b5b03f614c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:16.650266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a94c2-e7a3-41ad-9434-70b5b03f614c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:16.656959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a94c2-e7a3-41ad-9434-70b5b03f614c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:16.658674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a94c2-e7a3-41ad-9434-70b5b03f614c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:16.670816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-568a94c2-e7a3-41ad-9434-70b5b03f614c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:16.670816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:16.670816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:16.670816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:16.670816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:16.670816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:16.670816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:16.670816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:16.670816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:16.670816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:16.670816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:16.670816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:16.670816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:13:16.670816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:13:16.670816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:13:16.671679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:13:16.671679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:16.671679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:16.671679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:16.671679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:16.671679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:16.671679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:16.671679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:16.671679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:16.671679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:16.671679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:16.671679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:16.671679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:16.671679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:16.671679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:16.671679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:16.671679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:16.677436 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:13:16.677436 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:13:16.677436 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:13:16.677436 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:13:16.677436 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:13:16.677436 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:13:16.677436 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:16.677436 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:16.677436 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 489/989] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:13:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:16.680130 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b481d8-928d-45eb-bd14-4101a3ec7b6d None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:16.708356 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:16.785549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b481d8-928d-45eb-bd14-4101a3ec7b6d None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:16.792362 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a94c2-e7a3-41ad-9434-70b5b03f614c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:16.826851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec897ef-f674-4208-8724-79ccf55e8291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:16.827465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec897ef-f674-4208-8724-79ccf55e8291 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:16.827749 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec897ef-f674-4208-8724-79ccf55e8291 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:16.828024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec897ef-f674-4208-8724-79ccf55e8291 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:16.828725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec897ef-f674-4208-8724-79ccf55e8291 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:16.829036 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec897ef-f674-4208-8724-79ccf55e8291 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:16.830509 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec897ef-f674-4208-8724-79ccf55e8291 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:16.834636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:16.848146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 501/990] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:13:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:16.850575 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec897ef-f674-4208-8724-79ccf55e8291 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:16.904820 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a94c2-e7a3-41ad-9434-70b5b03f614c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:16.942417 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe055f-18bb-40ed-ae04-0ca12f31878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:16.943138 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe055f-18bb-40ed-ae04-0ca12f31878a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:16.943494 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe055f-18bb-40ed-ae04-0ca12f31878a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:16.943614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:16.943901 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe055f-18bb-40ed-ae04-0ca12f31878a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:16.944703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe055f-18bb-40ed-ae04-0ca12f31878a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:16.946274 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe055f-18bb-40ed-ae04-0ca12f31878a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:16.956162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-1efe055f-18bb-40ed-ae04-0ca12f31878a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:13:16.956162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:16.956162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:13:16.956162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:13:16.956162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:13:16.956162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:13:16.956162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:13:16.956162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:16.956162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:13:16.956162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:16.956162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:16.956162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:16.956162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:16.956162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:16.956162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:16.956162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:16.956162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:16.957460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:16.957460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:16.957460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:16.957460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:16.957460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:16.957460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:16.957460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:13:16.957460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:13:16.957460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:13:16.957460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:13:16.957460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:16.957460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:16.957460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:16.957460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:16.957460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:16.957460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:16.958533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:16.958533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:16.958533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:16.958533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:16.958533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:16.958533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:16.958533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:16.958533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:16.958533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:16.958533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:16.958533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:13:16.958533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:16.958533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:13:16.958533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:16.963956 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec897ef-f674-4208-8724-79ccf55e8291 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:16.964384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 490/991] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 16:13:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:16.965204 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe055f-18bb-40ed-ae04-0ca12f31878a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:17.000389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa41134-26c3-41ce-b12f-d5c1bbbbcbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:17.001073 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41134-26c3-41ce-b12f-d5c1bbbbcbe2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:17.001416 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41134-26c3-41ce-b12f-d5c1bbbbcbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:17.001751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41134-26c3-41ce-b12f-d5c1bbbbcbe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:17.002567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa41134-26c3-41ce-b12f-d5c1bbbbcbe2 None admin] RBAC: Adding query filter params (role.id=361e9c2a98ae4a7f925cd3ec46baf425, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=5fe3a02c2bc247efa354ca5bac39ec4e) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:17.002937 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa41134-26c3-41ce-b12f-d5c1bbbbcbe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:17.004419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa41134-26c3-41ce-b12f-d5c1bbbbcbe2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:17.010647 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 502/992] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:13:16 2022] GET /identity/v3/role_assignments?user.id=5fe3a02c2bc247efa354ca5bac39ec4e&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=361e9c2a98ae4a7f925cd3ec46baf425 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:17.075006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe055f-18bb-40ed-ae04-0ca12f31878a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:17.076718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:17.113310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db409a-7dbc-4a88-b08b-4f7f602c13bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:17.114037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db409a-7dbc-4a88-b08b-4f7f602c13bf None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:17.114415 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db409a-7dbc-4a88-b08b-4f7f602c13bf None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:17.114760 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db409a-7dbc-4a88-b08b-4f7f602c13bf None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:17.115478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db409a-7dbc-4a88-b08b-4f7f602c13bf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:17.115859 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db409a-7dbc-4a88-b08b-4f7f602c13bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:17.117870 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db409a-7dbc-4a88-b08b-4f7f602c13bf None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:17.128257 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 491/993] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 23 16:13:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:17.129404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa41134-26c3-41ce-b12f-d5c1bbbbcbe2 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:17.244922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa41134-26c3-41ce-b12f-d5c1bbbbcbe2 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:17.281870 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf105445-501d-4eb5-9a6c-57641d89b0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:17.282509 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf105445-501d-4eb5-9a6c-57641d89b0f7 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:17.282795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf105445-501d-4eb5-9a6c-57641d89b0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:17.283071 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf105445-501d-4eb5-9a6c-57641d89b0f7 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:17.283958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf105445-501d-4eb5-9a6c-57641d89b0f7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:17.284264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf105445-501d-4eb5-9a6c-57641d89b0f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:17.285620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf105445-501d-4eb5-9a6c-57641d89b0f7 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:17.295454 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 503/994] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 23 16:13:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:17.296604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db409a-7dbc-4a88-b08b-4f7f602c13bf None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:17.410174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db409a-7dbc-4a88-b08b-4f7f602c13bf None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:17.444644 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e2da7-6f36-4a15-b81b-425cfac9c565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:17.445187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e2da7-6f36-4a15-b81b-425cfac9c565 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:17.445469 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e2da7-6f36-4a15-b81b-425cfac9c565 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:17.445743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e2da7-6f36-4a15-b81b-425cfac9c565 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:17.446481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e2da7-6f36-4a15-b81b-425cfac9c565 None admin] RBAC: Adding query filter params (interface=admin, service_id=0dfa76016c9544d1bdb076c2429fea3a, region_id=RegionOne) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:17.446794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e2da7-6f36-4a15-b81b-425cfac9c565 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:17.448152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e2da7-6f36-4a15-b81b-425cfac9c565 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:17.457794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 492/995] 10.222.0.16 () {56 vars in 1249 bytes} [Tue Aug 23 16:13:17 2022] GET /identity/v3/endpoints?service_id=0dfa76016c9544d1bdb076c2429fea3a&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:17.458982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf105445-501d-4eb5-9a6c-57641d89b0f7 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:17.475464 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:17.568759 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf105445-501d-4eb5-9a6c-57641d89b0f7 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:17.604791 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee29b1e-f528-4768-a520-e3e5459462db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:17.605660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee29b1e-f528-4768-a520-e3e5459462db None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:17.606113 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee29b1e-f528-4768-a520-e3e5459462db None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:17.606554 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee29b1e-f528-4768-a520-e3e5459462db None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:17.607305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee29b1e-f528-4768-a520-e3e5459462db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:17.608825 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee29b1e-f528-4768-a520-e3e5459462db None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:17.622101 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 504/996] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 23 16:13:17 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:13:18.249550 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559787d3-9a87-4fa6-a758-46a1da5f3836 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:18.250086 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559787d3-9a87-4fa6-a758-46a1da5f3836 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:18.250209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559787d3-9a87-4fa6-a758-46a1da5f3836 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:18.251641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 493/997] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:18.256654 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4e850-0bfe-4c1e-8af2-d49a982bb726 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:18.256949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4e850-0bfe-4c1e-8af2-d49a982bb726 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:18.257258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4e850-0bfe-4c1e-8af2-d49a982bb726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:18.275729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-beb4e850-0bfe-4c1e-8af2-d49a982bb726 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:18.276938 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-beb4e850-0bfe-4c1e-8af2-d49a982bb726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:18.346703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 505/998] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:18.624990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559787d3-9a87-4fa6-a758-46a1da5f3836 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:18.657568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:18.737592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559787d3-9a87-4fa6-a758-46a1da5f3836 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:18.774270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1bab0-8f5a-4e3c-b677-e04c2f562cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:18.774904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1bab0-8f5a-4e3c-b677-e04c2f562cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:18.775179 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1bab0-8f5a-4e3c-b677-e04c2f562cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:18.775444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1bab0-8f5a-4e3c-b677-e04c2f562cb2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:18.776019 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1bab0-8f5a-4e3c-b677-e04c2f562cb2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:18.777400 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1bab0-8f5a-4e3c-b677-e04c2f562cb2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:18.786205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-c7f1bab0-8f5a-4e3c-b677-e04c2f562cb2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:13:18.786205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:18.786205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:13:18.786205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:13:18.786205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:13:18.786205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:13:18.786205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:13:18.786205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:18.786205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:13:18.786205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:18.786205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:18.786205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:18.786205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:18.786205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:18.786205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:18.786205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:18.786205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:18.787203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:18.787203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:18.787203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:18.787203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:18.787203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:18.787203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:18.787203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:13:18.787203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:13:18.787203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:13:18.787203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:13:18.787203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:18.787203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:18.787203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:18.787203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:18.787203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:18.787203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:18.788069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:18.788069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:18.788069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:18.788069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:18.788069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:18.788069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:18.788069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:18.788069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:18.788069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:18.788069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:18.788069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:13:18.788069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:18.788069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 16:13:18.788069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:18.790012 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 494/999] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:13:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:18.793069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4e850-0bfe-4c1e-8af2-d49a982bb726 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:18.803100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:18.893762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4e850-0bfe-4c1e-8af2-d49a982bb726 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:18.927991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bca4a6-6a96-4c76-889f-5e0ecc0fa80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:18.928592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bca4a6-6a96-4c76-889f-5e0ecc0fa80d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:18.928867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bca4a6-6a96-4c76-889f-5e0ecc0fa80d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:18.929806 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bca4a6-6a96-4c76-889f-5e0ecc0fa80d None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:18.930458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bca4a6-6a96-4c76-889f-5e0ecc0fa80d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:18.930764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bca4a6-6a96-4c76-889f-5e0ecc0fa80d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:18.932119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bca4a6-6a96-4c76-889f-5e0ecc0fa80d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:18.937008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 506/1000] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 16:13:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:18.942578 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1bab0-8f5a-4e3c-b677-e04c2f562cb2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:18.981832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec810a0-fa6b-4d49-87f7-73a0e4b9376a None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:18.982186 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec810a0-fa6b-4d49-87f7-73a0e4b9376a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:18.982458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec810a0-fa6b-4d49-87f7-73a0e4b9376a None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:18.983793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 507/1001] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:13:18.988705 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc9588-59da-4284-ba1a-b71d7c6eb639 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:18.988989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc9588-59da-4284-ba1a-b71d7c6eb639 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:18.989267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc9588-59da-4284-ba1a-b71d7c6eb639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:19.008542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-cabc9588-59da-4284-ba1a-b71d7c6eb639 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:19.009857 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-cabc9588-59da-4284-ba1a-b71d7c6eb639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:19.044379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:19.052808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1bab0-8f5a-4e3c-b677-e04c2f562cb2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:19.086183 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 508/1002] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:13:19.094033 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714375d-399c-42ec-a262-cf40621966ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:19.094835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714375d-399c-42ec-a262-cf40621966ba None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:19.095288 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714375d-399c-42ec-a262-cf40621966ba None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:19.095704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714375d-399c-42ec-a262-cf40621966ba None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:19.096482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714375d-399c-42ec-a262-cf40621966ba None admin] RBAC: Adding query filter params (type=compute) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:19.096966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714375d-399c-42ec-a262-cf40621966ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:19.098548 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714375d-399c-42ec-a262-cf40621966ba None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:19.105660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 495/1003] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 16:13:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:19.111224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc9588-59da-4284-ba1a-b71d7c6eb639 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:19.113859 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:19.223974 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc9588-59da-4284-ba1a-b71d7c6eb639 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:19.260254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0b596-7dc1-4856-a7af-9154ae090366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:19.260867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0b596-7dc1-4856-a7af-9154ae090366 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:19.261146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0b596-7dc1-4856-a7af-9154ae090366 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:19.261417 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0b596-7dc1-4856-a7af-9154ae090366 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:19.262106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0b596-7dc1-4856-a7af-9154ae090366 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:19.263481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0b596-7dc1-4856-a7af-9154ae090366 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:19.286214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 509/1004] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 16:13:19 2022] POST /identity/v3/endpoints => generated 334 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:13:19.363158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714375d-399c-42ec-a262-cf40621966ba None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:19.483149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714375d-399c-42ec-a262-cf40621966ba None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:19.527675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780ba94-8ebf-46b9-88bb-38e1e104cec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:19.528307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780ba94-8ebf-46b9-88bb-38e1e104cec3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:19.528583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780ba94-8ebf-46b9-88bb-38e1e104cec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:19.528850 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780ba94-8ebf-46b9-88bb-38e1e104cec3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:19.529462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c780ba94-8ebf-46b9-88bb-38e1e104cec3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:19.530857 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c780ba94-8ebf-46b9-88bb-38e1e104cec3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:19.540846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-c780ba94-8ebf-46b9-88bb-38e1e104cec3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:13:19.540846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:19.540846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:13:19.540846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:13:19.540846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:13:19.540846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:13:19.540846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:13:19.540846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:19.540846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:13:19.540846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:19.540846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:19.540846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:19.540846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:19.540846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:19.540846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:19.540846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:19.540846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:19.541854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:19.541854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:19.541854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:19.541854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:19.541854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:19.541854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:19.541854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:13:19.541854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:13:19.541854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:13:19.541854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:13:19.541854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:19.541854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:19.541854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:19.541854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:19.541854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:19.541854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:19.542832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:19.542832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:19.542832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:19.542832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:19.542832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:19.542832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:19.542832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:19.542832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:19.542832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:19.542832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:19.542832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:13:19.542832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:19.542832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:13:19.542832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:19.542832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 496/1005] 10.222.0.16 () {56 vars in 1105 bytes} [Tue Aug 23 16:13:19 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:19.547915 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0b596-7dc1-4856-a7af-9154ae090366 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:19.585493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0627f5-fb04-4aae-9f5a-8443aee188a4 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:19.585917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0627f5-fb04-4aae-9f5a-8443aee188a4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:19.586445 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0627f5-fb04-4aae-9f5a-8443aee188a4 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:19.587925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 497/1006] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:13:19.592833 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec67e96-fb15-4409-9385-052ec5800759 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:19.593115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec67e96-fb15-4409-9385-052ec5800759 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:19.593393 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec67e96-fb15-4409-9385-052ec5800759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:19.612207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-dec67e96-fb15-4409-9385-052ec5800759 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:19.613515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dec67e96-fb15-4409-9385-052ec5800759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:19.624832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:19.628499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:19.671064 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0b596-7dc1-4856-a7af-9154ae090366 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:19.694204 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 498/1007] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:19 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:13:19.704608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5840734-ecd6-4912-abd8-12eb95798a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:19.705224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5840734-ecd6-4912-abd8-12eb95798a6c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:19.705508 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5840734-ecd6-4912-abd8-12eb95798a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:19.705782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5840734-ecd6-4912-abd8-12eb95798a6c None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:19.706452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5840734-ecd6-4912-abd8-12eb95798a6c None admin] RBAC: Adding query filter params (name=image) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:19.706756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5840734-ecd6-4912-abd8-12eb95798a6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:19.708133 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5840734-ecd6-4912-abd8-12eb95798a6c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:19.714006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 510/1008] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:19.719369 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec67e96-fb15-4409-9385-052ec5800759 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:19.822375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec67e96-fb15-4409-9385-052ec5800759 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:19.856173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833086d-6896-4ead-af6a-ec3221474629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:19.856783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833086d-6896-4ead-af6a-ec3221474629 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:19.857095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833086d-6896-4ead-af6a-ec3221474629 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:19.857377 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833086d-6896-4ead-af6a-ec3221474629 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:19.859445 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833086d-6896-4ead-af6a-ec3221474629 None admin] RBAC: Adding query filter params (type=image) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:19.859445 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833086d-6896-4ead-af6a-ec3221474629 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:19.859725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833086d-6896-4ead-af6a-ec3221474629 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:19.869222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 499/1009] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:19.967619 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5840734-ecd6-4912-abd8-12eb95798a6c None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:20.075624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5840734-ecd6-4912-abd8-12eb95798a6c None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:20.099149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:20.112469 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f810cb2-c8a8-4983-935d-34593ca1a778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:20.113097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f810cb2-c8a8-4983-935d-34593ca1a778 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:20.113374 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f810cb2-c8a8-4983-935d-34593ca1a778 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:20.113643 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f810cb2-c8a8-4983-935d-34593ca1a778 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:20.114258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f810cb2-c8a8-4983-935d-34593ca1a778 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:20.115667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f810cb2-c8a8-4983-935d-34593ca1a778 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:20.125149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-1f810cb2-c8a8-4983-935d-34593ca1a778 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:13:20.125149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:20.125149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:13:20.125149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:13:20.125149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:13:20.125149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:13:20.125149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:13:20.125149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:20.125149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:13:20.125149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:20.125149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:20.125149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:20.125149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:20.125149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:20.125149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:20.125149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:20.125149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:20.126538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:20.126538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:20.126538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:20.126538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:20.126538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:20.126538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:20.126538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:13:20.126538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:13:20.126538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:13:20.126538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:13:20.126538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:20.126538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:20.126538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:20.126538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:20.126538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:20.126538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:20.127399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:20.127399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:20.127399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:20.127399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:20.127399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:20.127399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:20.127399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:20.127399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:20.127399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:20.127399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:20.127399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:13:20.127399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:20.127399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 16:13:20.127399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:20.127399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 511/1010] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 16:13:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:20.132553 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833086d-6896-4ead-af6a-ec3221474629 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:20.147598 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:20.242528 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833086d-6896-4ead-af6a-ec3221474629 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:20.277129 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435e4dc-0d7e-43fe-9165-ba2c29d1605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:20.277740 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435e4dc-0d7e-43fe-9165-ba2c29d1605d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:20.278021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435e4dc-0d7e-43fe-9165-ba2c29d1605d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:20.278321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435e4dc-0d7e-43fe-9165-ba2c29d1605d None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:20.278949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435e4dc-0d7e-43fe-9165-ba2c29d1605d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:20.279254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435e4dc-0d7e-43fe-9165-ba2c29d1605d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:20.280605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435e4dc-0d7e-43fe-9165-ba2c29d1605d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:20.290701 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 500/1011] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 23 16:13:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:20.291977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f810cb2-c8a8-4983-935d-34593ca1a778 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:20.398469 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f810cb2-c8a8-4983-935d-34593ca1a778 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:20.434832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142eab6d-8d61-44fc-863a-41857cd44efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:20.435438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142eab6d-8d61-44fc-863a-41857cd44efd None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:20.435714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142eab6d-8d61-44fc-863a-41857cd44efd None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:20.435983 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142eab6d-8d61-44fc-863a-41857cd44efd None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:20.436610 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142eab6d-8d61-44fc-863a-41857cd44efd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:20.436911 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142eab6d-8d61-44fc-863a-41857cd44efd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:20.438299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142eab6d-8d61-44fc-863a-41857cd44efd None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:20.447919 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 512/1012] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 23 16:13:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:20.448890 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435e4dc-0d7e-43fe-9165-ba2c29d1605d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:20.529409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:20.552829 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435e4dc-0d7e-43fe-9165-ba2c29d1605d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:20.586388 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05043aff-4d2a-4c51-89ff-409ec2851a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:20.586992 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05043aff-4d2a-4c51-89ff-409ec2851a30 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:20.587325 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05043aff-4d2a-4c51-89ff-409ec2851a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:20.587600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05043aff-4d2a-4c51-89ff-409ec2851a30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:20.588245 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05043aff-4d2a-4c51-89ff-409ec2851a30 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:20.589585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05043aff-4d2a-4c51-89ff-409ec2851a30 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:20.606631 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 501/1013] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 16:13:20 2022] POST /identity/v3/endpoints => generated 325 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:13:21.348715 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc81fe-14d4-4202-a061-3c19e30d73d5 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:21.349245 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc81fe-14d4-4202-a061-3c19e30d73d5 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:21.349245 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc81fe-14d4-4202-a061-3c19e30d73d5 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:21.350670 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 513/1014] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:21.356799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99eec4-5a95-4a8e-aa8f-dc71e20cc02d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:21.357100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99eec4-5a95-4a8e-aa8f-dc71e20cc02d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:21.357379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99eec4-5a95-4a8e-aa8f-dc71e20cc02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:21.376151 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-eb99eec4-5a95-4a8e-aa8f-dc71e20cc02d None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:21.377327 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-eb99eec4-5a95-4a8e-aa8f-dc71e20cc02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:21.450867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 502/1015] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:21 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:21.722261 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc81fe-14d4-4202-a061-3c19e30d73d5 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:21.775100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:21.820410 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a928aee-351a-4888-8f8a-211d9e9559c8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:21.820692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a928aee-351a-4888-8f8a-211d9e9559c8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:21.820966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a928aee-351a-4888-8f8a-211d9e9559c8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:21.822439 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 503/1016] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:21.827626 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887b12-b210-4da2-a4c0-f6cab77de9f4 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:21.827919 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887b12-b210-4da2-a4c0-f6cab77de9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:21.828202 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887b12-b210-4da2-a4c0-f6cab77de9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:21.833247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc81fe-14d4-4202-a061-3c19e30d73d5 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:21.846332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-dd887b12-b210-4da2-a4c0-f6cab77de9f4 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:21.847529 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dd887b12-b210-4da2-a4c0-f6cab77de9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:21.869738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733c6b5-83a4-4041-88f7-bd7b5fe69609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:21.870404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733c6b5-83a4-4041-88f7-bd7b5fe69609 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:21.870683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733c6b5-83a4-4041-88f7-bd7b5fe69609 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:21.870960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733c6b5-83a4-4041-88f7-bd7b5fe69609 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:21.881476 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733c6b5-83a4-4041-88f7-bd7b5fe69609 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:13:21.887015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-b733c6b5-83a4-4041-88f7-bd7b5fe69609 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:13:21.887015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:21.887015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:21.887015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:21.887015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:21.887015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:21.887015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:21.887015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:21.887015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:21.887015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:21.887015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:21.887015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:21.887015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:13:21.887015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:13:21.887015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:13:21.887015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:13:21.888056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:13:21.888056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:13:21.888056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:13:21.888056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:13:21.888056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:21.888056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:21.888056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:21.888056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:21.888056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:21.888056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:21.888056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:21.888056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:21.888056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:21.888056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:21.888056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:21.888056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:21.888935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:21.888935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:21.888935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:21.888935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:21.888935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:13:21.888935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:13:21.888935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:13:21.888935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:13:21.888935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:13:21.888935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:13:21.888935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:13:21.888935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:21.888935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 514/1017] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 23 16:13:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:21.894092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733c6b5-83a4-4041-88f7-bd7b5fe69609 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:21.908644 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:21.920820 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 504/1018] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:21 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:13:22.001662 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733c6b5-83a4-4041-88f7-bd7b5fe69609 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:22.012738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:22.037775 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830c689-3a1c-4267-8ffc-b14537e88f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:22.039140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c689-3a1c-4267-8ffc-b14537e88f42 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:22.039591 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c689-3a1c-4267-8ffc-b14537e88f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:22.040017 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830c689-3a1c-4267-8ffc-b14537e88f42 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:22.040696 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830c689-3a1c-4267-8ffc-b14537e88f42 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:22.040999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830c689-3a1c-4267-8ffc-b14537e88f42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:22.042384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830c689-3a1c-4267-8ffc-b14537e88f42 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:22.051053 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 515/1019] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 23 16:13:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:22.057205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd887b12-b210-4da2-a4c0-f6cab77de9f4 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:22.157122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd887b12-b210-4da2-a4c0-f6cab77de9f4 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:22.193291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830c689-3a1c-4267-8ffc-b14537e88f42 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:22.202689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c98d8-9f81-40ee-9975-124e0815cbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:22.203329 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c98d8-9f81-40ee-9975-124e0815cbf0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:22.203607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c98d8-9f81-40ee-9975-124e0815cbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:22.203881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c98d8-9f81-40ee-9975-124e0815cbf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:22.215226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c98d8-9f81-40ee-9975-124e0815cbf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:22.216667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c98d8-9f81-40ee-9975-124e0815cbf0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:22.232244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-ca7c98d8-9f81-40ee-9975-124e0815cbf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:22.232244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:22.232244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:22.232244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:22.232244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:22.232244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:22.232244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:22.232244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:22.232244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:22.232244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:22.232244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:22.232244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:22.232244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:22.232244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:22.232244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:22.232244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:22.233219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:22.233219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:22.233219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:22.233219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:22.233219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:22.233219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:22.233219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:22.233219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:22.233219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:22.233219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:22.233219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:22.233219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:22.233219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:22.233219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:22.233219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:22.233219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:22.233219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:22.234144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:22.234144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:22.234144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:22.238266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 505/1020] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:22.239495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c98d8-9f81-40ee-9975-124e0815cbf0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:22.296216 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:22.306340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830c689-3a1c-4267-8ffc-b14537e88f42 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:22.342837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d3492-92b8-4b5b-a882-df5cf029f391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:22.343444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d3492-92b8-4b5b-a882-df5cf029f391 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:22.343722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d3492-92b8-4b5b-a882-df5cf029f391 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:22.343995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d3492-92b8-4b5b-a882-df5cf029f391 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:22.344646 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d3492-92b8-4b5b-a882-df5cf029f391 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:22.346006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d3492-92b8-4b5b-a882-df5cf029f391 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:22.358715 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c98d8-9f81-40ee-9975-124e0815cbf0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:22.363282 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 516/1021] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 16:13:22 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:13:22.404980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22b005-b6d3-481f-8076-0da3be5fb4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:22.405606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22b005-b6d3-481f-8076-0da3be5fb4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:22.405891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22b005-b6d3-481f-8076-0da3be5fb4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:22.406200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22b005-b6d3-481f-8076-0da3be5fb4b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:22.406865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22b005-b6d3-481f-8076-0da3be5fb4b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:22.407173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22b005-b6d3-481f-8076-0da3be5fb4b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:22.408859 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22b005-b6d3-481f-8076-0da3be5fb4b2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:22.427679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 506/1022] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:22.430008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d3492-92b8-4b5b-a882-df5cf029f391 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:22.467507 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:22.524544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db44bb-269d-47ea-982e-8a165de361e5 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:22.525103 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db44bb-269d-47ea-982e-8a165de361e5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:22.525103 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db44bb-269d-47ea-982e-8a165de361e5 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:22.526792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 507/1023] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:13:22.532065 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e5444-1dde-4abc-a795-262a119a3826 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:22.532347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e5444-1dde-4abc-a795-262a119a3826 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:22.532620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e5444-1dde-4abc-a795-262a119a3826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:22.548381 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d3492-92b8-4b5b-a882-df5cf029f391 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:22.557776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-dc7e5444-1dde-4abc-a795-262a119a3826 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:22.559437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dc7e5444-1dde-4abc-a795-262a119a3826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:22.585535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cf822-fddb-49a7-812e-67cb19a8e66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:22.586196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cf822-fddb-49a7-812e-67cb19a8e66d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:22.586482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cf822-fddb-49a7-812e-67cb19a8e66d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:22.586755 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cf822-fddb-49a7-812e-67cb19a8e66d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:22.594629 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cf822-fddb-49a7-812e-67cb19a8e66d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:22.596138 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cf822-fddb-49a7-812e-67cb19a8e66d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:22.609015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-025cf822-fddb-49a7-812e-67cb19a8e66d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:13:22.609015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:22.609015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:22.609015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:22.609015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:22.609015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:22.609015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:22.609015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:22.609015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:22.609015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:22.609015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:22.609015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:22.609015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:13:22.609015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:13:22.609015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:13:22.609015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:13:22.610018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:22.610018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:22.610018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:13:22.610018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:22.610018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:13:22.610018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:22.610018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:22.610018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:22.610018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:22.610018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:22.610018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:22.610018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:22.610018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:22.610018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:22.610018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:22.610018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:22.610018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:22.610018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:22.611642 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:22.611642 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:22.611642 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:13:22.611642 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:13:22.611642 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:13:22.611642 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:13:22.611642 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:13:22.611642 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:13:22.611642 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:13:22.611642 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:22.611642 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 517/1024] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 23 16:13:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:22.616154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cf822-fddb-49a7-812e-67cb19a8e66d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:22.635322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 508/1025] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:13:22.709895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:22.719922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cf822-fddb-49a7-812e-67cb19a8e66d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:22.753842 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac07fc-4ee6-48d6-a200-b33898eca071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:22.754523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac07fc-4ee6-48d6-a200-b33898eca071 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:22.754806 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac07fc-4ee6-48d6-a200-b33898eca071 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:22.755077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac07fc-4ee6-48d6-a200-b33898eca071 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:22.755803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac07fc-4ee6-48d6-a200-b33898eca071 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:22.756111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac07fc-4ee6-48d6-a200-b33898eca071 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:22.758163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac07fc-4ee6-48d6-a200-b33898eca071 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:22.775716 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 518/1026] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 23 16:13:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:22.781763 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e5444-1dde-4abc-a795-262a119a3826 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:22.815403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:22.891071 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e5444-1dde-4abc-a795-262a119a3826 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:22.915851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac07fc-4ee6-48d6-a200-b33898eca071 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:22.927807 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cf8e6-5363-4ab4-93fa-cda091d8b874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:22.928427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cf8e6-5363-4ab4-93fa-cda091d8b874 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:22.928740 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cf8e6-5363-4ab4-93fa-cda091d8b874 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:22.929549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cf8e6-5363-4ab4-93fa-cda091d8b874 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:22.996518 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cf8e6-5363-4ab4-93fa-cda091d8b874 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:22.997970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cf8e6-5363-4ab4-93fa-cda091d8b874 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:23.028465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:23.029800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac07fc-4ee6-48d6-a200-b33898eca071 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:23.067476 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bcd00-fba7-4cec-befa-415c22a36d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:23.068026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bcd00-fba7-4cec-befa-415c22a36d4f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:23.068306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bcd00-fba7-4cec-befa-415c22a36d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:23.068580 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bcd00-fba7-4cec-befa-415c22a36d4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:23.069812 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125bcd00-fba7-4cec-befa-415c22a36d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:23.071275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125bcd00-fba7-4cec-befa-415c22a36d4f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:23.072998 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 519/1027] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:23.078787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bcd00-fba7-4cec-befa-415c22a36d4f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:23.098215 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:23.109847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 509/1028] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:13:22 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:13:23.115461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cf8e6-5363-4ab4-93fa-cda091d8b874 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:23.205114 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bcd00-fba7-4cec-befa-415c22a36d4f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:23.217968 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cf8e6-5363-4ab4-93fa-cda091d8b874 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:23.240876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d125b05-f4fd-4559-80d4-79fcb230a8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:23.242197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d125b05-f4fd-4559-80d4-79fcb230a8f6 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:23.242483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d125b05-f4fd-4559-80d4-79fcb230a8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:23.242762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d125b05-f4fd-4559-80d4-79fcb230a8f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:23.243411 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d125b05-f4fd-4559-80d4-79fcb230a8f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:23.244840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d125b05-f4fd-4559-80d4-79fcb230a8f6 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:23.249543 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:23.258057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfcbe4-9288-4174-88f9-e60b055519ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:23.258716 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfcbe4-9288-4174-88f9-e60b055519ee None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:23.258997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfcbe4-9288-4174-88f9-e60b055519ee None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:23.259270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfcbe4-9288-4174-88f9-e60b055519ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:23.270364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfcbe4-9288-4174-88f9-e60b055519ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:23.271792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfcbe4-9288-4174-88f9-e60b055519ee None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:23.274243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 520/1029] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 16:13:23 2022] POST /identity/v3/projects => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:13:23.292491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e3cfcbe4-9288-4174-88f9-e60b055519ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:23.292491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:23.292491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:23.292491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:23.292491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:23.292491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:23.292491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:23.292491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:23.292491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:23.292491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:23.292491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:23.292491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:23.292491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:23.292491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:23.292491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:23.292491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:23.293620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:23.293620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:23.293620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:23.293620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:23.293620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:23.293620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:23.293620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:23.293620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:23.293620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:23.293620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:23.293620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:23.293620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:23.293620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:23.293620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:23.293620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:23.293620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:23.293620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:23.295009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:23.295009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:23.295009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:23.295555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 510/1030] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:23.299756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d125b05-f4fd-4559-80d4-79fcb230a8f6 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:23.380354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:23.420407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d125b05-f4fd-4559-80d4-79fcb230a8f6 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:23.457656 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0576e-c65d-43ba-8165-5e25fc95b363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:23.458330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0576e-c65d-43ba-8165-5e25fc95b363 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:23.458615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0576e-c65d-43ba-8165-5e25fc95b363 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:23.458891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0576e-c65d-43ba-8165-5e25fc95b363 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:23.459564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0576e-c65d-43ba-8165-5e25fc95b363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:23.459953 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0576e-c65d-43ba-8165-5e25fc95b363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:23.461435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0576e-c65d-43ba-8165-5e25fc95b363 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:23.476500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 521/1031] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:23.482296 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfcbe4-9288-4174-88f9-e60b055519ee None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:23.586025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfcbe4-9288-4174-88f9-e60b055519ee None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:23.619116 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae709940-4060-443a-86f4-10e42c5b4a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:23.619755 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae709940-4060-443a-86f4-10e42c5b4a8c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:23.620035 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae709940-4060-443a-86f4-10e42c5b4a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:23.620311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae709940-4060-443a-86f4-10e42c5b4a8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:23.627061 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae709940-4060-443a-86f4-10e42c5b4a8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:23.628491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae709940-4060-443a-86f4-10e42c5b4a8c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:23.640995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-ae709940-4060-443a-86f4-10e42c5b4a8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:23.640995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:23.640995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:23.640995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:23.640995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:23.640995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:23.640995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:23.640995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:23.640995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:23.640995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:23.640995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:23.640995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:23.640995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:13:23.640995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:13:23.640995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:13:23.641923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:13:23.641923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:23.641923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:23.641923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:23.641923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:23.641923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:23.641923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:23.641923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:23.641923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:23.641923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:23.641923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:23.641923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:23.641923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:23.641923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:23.641923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:23.641923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:23.641923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:23.643150 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:13:23.643150 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:13:23.643150 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:13:23.643150 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:13:23.643150 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:13:23.643150 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:13:23.643150 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:23.643150 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:23.643981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 511/1032] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:13:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:23.649093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0576e-c65d-43ba-8165-5e25fc95b363 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:23.751357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0576e-c65d-43ba-8165-5e25fc95b363 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:23.782102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:23.789914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038a510-2a4e-4bc0-af03-da05dcb30029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:23.790549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038a510-2a4e-4bc0-af03-da05dcb30029 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:23.790834 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038a510-2a4e-4bc0-af03-da05dcb30029 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:23.791108 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038a510-2a4e-4bc0-af03-da05dcb30029 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:23.791801 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038a510-2a4e-4bc0-af03-da05dcb30029 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:23.792110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038a510-2a4e-4bc0-af03-da05dcb30029 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:23.793543 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038a510-2a4e-4bc0-af03-da05dcb30029 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:23.806097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 522/1033] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:13:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:23.811950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae709940-4060-443a-86f4-10e42c5b4a8c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:23.857280 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:23.915441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae709940-4060-443a-86f4-10e42c5b4a8c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:23.949359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7e8fd-0ef4-4f73-94c1-f1e44451ea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:23.949971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7e8fd-0ef4-4f73-94c1-f1e44451ea6e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:23.950281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7e8fd-0ef4-4f73-94c1-f1e44451ea6e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:23.950559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7e8fd-0ef4-4f73-94c1-f1e44451ea6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:23.951286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7e8fd-0ef4-4f73-94c1-f1e44451ea6e None admin] RBAC: Adding query filter params (role.id=361e9c2a98ae4a7f925cd3ec46baf425, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=767ca33ca8e244f8a0cc773e3b6abefb) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:23.951599 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7e8fd-0ef4-4f73-94c1-f1e44451ea6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:23.953029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7e8fd-0ef4-4f73-94c1-f1e44451ea6e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:23.966192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 512/1034] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:13:23 2022] GET /identity/v3/role_assignments?user.id=767ca33ca8e244f8a0cc773e3b6abefb&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=361e9c2a98ae4a7f925cd3ec46baf425 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:24.325819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad87fa-179d-4681-ba62-f1580c77e34b None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:24.326164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad87fa-179d-4681-ba62-f1580c77e34b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:24.326411 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad87fa-179d-4681-ba62-f1580c77e34b None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:24.327792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 523/1035] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:24.332986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596c6d9-1af9-487b-b7bf-f6362b2897dd None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:24.333273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596c6d9-1af9-487b-b7bf-f6362b2897dd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:24.333549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596c6d9-1af9-487b-b7bf-f6362b2897dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:24.352128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e596c6d9-1af9-487b-b7bf-f6362b2897dd None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:24.353321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e596c6d9-1af9-487b-b7bf-f6362b2897dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:24.424289 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 513/1036] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:24.694323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad87fa-179d-4681-ba62-f1580c77e34b None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:24.798683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad87fa-179d-4681-ba62-f1580c77e34b None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:24.833380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dabc5-35cb-4bbc-a204-acb7b88c294c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:24.834006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dabc5-35cb-4bbc-a204-acb7b88c294c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:24.834313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dabc5-35cb-4bbc-a204-acb7b88c294c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:24.834588 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dabc5-35cb-4bbc-a204-acb7b88c294c None admin] PATH_INFO: `/v3/services/image` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:24.835196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878dabc5-35cb-4bbc-a204-acb7b88c294c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:24.836565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878dabc5-35cb-4bbc-a204-acb7b88c294c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:24.845335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-878dabc5-35cb-4bbc-a204-acb7b88c294c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:13:24.845335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:24.845335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:13:24.845335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:13:24.845335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:13:24.845335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:13:24.845335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:13:24.845335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:24.845335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:13:24.845335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:24.845335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:24.845335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:24.845335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:24.845335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:24.845335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:24.845335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:24.845335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:24.846340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:24.846340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:24.846340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:24.846340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:24.846340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:24.846340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:24.846340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:13:24.846340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:13:24.846340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:13:24.846340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:13:24.846340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:24.846340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:24.846340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:24.846340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:24.846340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:24.846340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:24.847182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:24.847182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:24.847182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:24.847182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:24.847182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:24.847182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:24.847182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:24.847182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:24.847182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:24.847182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:24.847182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:13:24.847182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:24.847182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:13:24.847182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:24.850396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 524/1037] 10.222.0.16 () {56 vars in 1105 bytes} [Tue Aug 23 16:13:24 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:24.852957 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596c6d9-1af9-487b-b7bf-f6362b2897dd None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:24.889381 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:24.958952 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596c6d9-1af9-487b-b7bf-f6362b2897dd None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:24.993139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827846d9-bb03-485f-8f88-8b75029f3769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:24.993749 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827846d9-bb03-485f-8f88-8b75029f3769 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:24.994030 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827846d9-bb03-485f-8f88-8b75029f3769 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:24.994336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827846d9-bb03-485f-8f88-8b75029f3769 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:24.994970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827846d9-bb03-485f-8f88-8b75029f3769 None admin] RBAC: Adding query filter params (name=image) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:24.995274 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827846d9-bb03-485f-8f88-8b75029f3769 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:24.996640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827846d9-bb03-485f-8f88-8b75029f3769 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:25.006118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 514/1038] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:25.007679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dabc5-35cb-4bbc-a204-acb7b88c294c None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:25.068040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:25.115447 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dabc5-35cb-4bbc-a204-acb7b88c294c None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:25.156149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29734eae-1a21-4d71-bba1-d0a7b6a295c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:25.156758 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29734eae-1a21-4d71-bba1-d0a7b6a295c7 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:25.157040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29734eae-1a21-4d71-bba1-d0a7b6a295c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:25.157315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29734eae-1a21-4d71-bba1-d0a7b6a295c7 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:25.161622 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29734eae-1a21-4d71-bba1-d0a7b6a295c7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:25.161622 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29734eae-1a21-4d71-bba1-d0a7b6a295c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:25.161622 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29734eae-1a21-4d71-bba1-d0a7b6a295c7 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:25.172405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 525/1039] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:25.173393 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827846d9-bb03-485f-8f88-8b75029f3769 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:25.261232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a70cd-61e5-40cb-9072-e63f442dff64 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:25.261429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a70cd-61e5-40cb-9072-e63f442dff64 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:25.261698 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a70cd-61e5-40cb-9072-e63f442dff64 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:25.263285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 526/1040] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:25.269123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f03eb4-5e94-4c0f-92c8-674cdac1d485 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:25.269411 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f03eb4-5e94-4c0f-92c8-674cdac1d485 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:25.269687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f03eb4-5e94-4c0f-92c8-674cdac1d485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:25.272531 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:25.276133 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827846d9-bb03-485f-8f88-8b75029f3769 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:25.288863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-96f03eb4-5e94-4c0f-92c8-674cdac1d485 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:25.290088 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-96f03eb4-5e94-4c0f-92c8-674cdac1d485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:25.313996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fdbae-0a86-4420-861f-32d361453b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:25.314652 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fdbae-0a86-4420-861f-32d361453b77 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:25.314934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fdbae-0a86-4420-861f-32d361453b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:25.315221 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fdbae-0a86-4420-861f-32d361453b77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:25.315915 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fdbae-0a86-4420-861f-32d361453b77 None admin] RBAC: Adding query filter params (interface=public, service_id=a7256599789247a69aaec765c9ebe384, region_id=RegionOne) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:25.316225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fdbae-0a86-4420-861f-32d361453b77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:25.317601 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fdbae-0a86-4420-861f-32d361453b77 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:25.323477 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 515/1041] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 23 16:13:25 2022] GET /identity/v3/endpoints?service_id=a7256599789247a69aaec765c9ebe384&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:25.328941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fdbae-0a86-4420-861f-32d361453b77 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:25.362105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 527/1042] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:13:25.429299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fdbae-0a86-4420-861f-32d361453b77 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:25.463492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aec618-76ea-4db6-9e33-d0d50181a4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:25.464119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aec618-76ea-4db6-9e33-d0d50181a4ea None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:25.464396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aec618-76ea-4db6-9e33-d0d50181a4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:25.464668 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aec618-76ea-4db6-9e33-d0d50181a4ea None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:25.465272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aec618-76ea-4db6-9e33-d0d50181a4ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:25.466667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aec618-76ea-4db6-9e33-d0d50181a4ea None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:25.479031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 516/1043] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 23 16:13:25 2022] GET /identity/v3/services => generated 1957 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:13:25.639962 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f03eb4-5e94-4c0f-92c8-674cdac1d485 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:25.690862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:25.743908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f03eb4-5e94-4c0f-92c8-674cdac1d485 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:25.779105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be91ee98-f21b-4eba-86db-59be32f34276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:25.779734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91ee98-f21b-4eba-86db-59be32f34276 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:25.780016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91ee98-f21b-4eba-86db-59be32f34276 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:25.780290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be91ee98-f21b-4eba-86db-59be32f34276 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:25.781411 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91ee98-f21b-4eba-86db-59be32f34276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:25.782871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be91ee98-f21b-4eba-86db-59be32f34276 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:25.784865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 528/1044] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:25.791068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aec618-76ea-4db6-9e33-d0d50181a4ea None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:25.821496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:25.880225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13981c-87a4-41ef-ad3c-f12a4d846575 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:25.880555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13981c-87a4-41ef-ad3c-f12a4d846575 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:25.880767 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13981c-87a4-41ef-ad3c-f12a4d846575 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:25.882308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 529/1045] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:13:25.887251 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63377f8e-6898-4a3b-932a-c6de8f7551fe None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:25.887621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63377f8e-6898-4a3b-932a-c6de8f7551fe None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:25.887967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63377f8e-6898-4a3b-932a-c6de8f7551fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:25.898334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aec618-76ea-4db6-9e33-d0d50181a4ea None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:25.906322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-63377f8e-6898-4a3b-932a-c6de8f7551fe None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:25.907523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-63377f8e-6898-4a3b-932a-c6de8f7551fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:25.942901 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7174e7-d386-436d-9247-d49b5711ed3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:25.943514 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7174e7-d386-436d-9247-d49b5711ed3e None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:25.943789 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7174e7-d386-436d-9247-d49b5711ed3e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:25.944055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7174e7-d386-436d-9247-d49b5711ed3e None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:25.945078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7174e7-d386-436d-9247-d49b5711ed3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:25.946519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7174e7-d386-436d-9247-d49b5711ed3e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:25.968616 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 517/1046] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 16:13:25 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:13:25.982134 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 530/1047] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:26.249100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7174e7-d386-436d-9247-d49b5711ed3e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:26.332929 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:26.352667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7174e7-d386-436d-9247-d49b5711ed3e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:26.386426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59746db-58a7-4a24-b1dc-0c828239ac6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:26.387054 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59746db-58a7-4a24-b1dc-0c828239ac6b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:26.387332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59746db-58a7-4a24-b1dc-0c828239ac6b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:26.387601 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59746db-58a7-4a24-b1dc-0c828239ac6b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:26.397414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59746db-58a7-4a24-b1dc-0c828239ac6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:13:26.402608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-c59746db-58a7-4a24-b1dc-0c828239ac6b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:13:26.402608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:26.402608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:26.402608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:26.402608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:26.402608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:26.402608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:26.402608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:26.402608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:26.402608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:26.402608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:26.402608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:26.402608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:13:26.402608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:13:26.402608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:13:26.402608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:13:26.403535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:13:26.403535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:13:26.403535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:13:26.403535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:13:26.403535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:26.403535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:26.403535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:26.403535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:26.403535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:26.403535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:26.403535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:26.403535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:26.403535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:26.403535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:26.403535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:26.403535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:26.404403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:26.404403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:26.404403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:26.404403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:26.404403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:13:26.404403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:13:26.404403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:13:26.404403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:13:26.404403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:13:26.404403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:13:26.404403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:13:26.404403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:26.405625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 518/1048] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 23 16:13:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:26.410053 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63377f8e-6898-4a3b-932a-c6de8f7551fe None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:26.457446 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:26.516691 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63377f8e-6898-4a3b-932a-c6de8f7551fe None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:26.552067 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7707d-3689-4096-9690-8de044de50c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:26.552736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7707d-3689-4096-9690-8de044de50c7 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:26.553018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7707d-3689-4096-9690-8de044de50c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:26.553313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7707d-3689-4096-9690-8de044de50c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:26.554374 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7707d-3689-4096-9690-8de044de50c7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:26.554687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7707d-3689-4096-9690-8de044de50c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:26.556064 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7707d-3689-4096-9690-8de044de50c7 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:26.568864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 531/1049] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 23 16:13:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:26.570625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59746db-58a7-4a24-b1dc-0c828239ac6b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:26.674127 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59746db-58a7-4a24-b1dc-0c828239ac6b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:26.707580 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeb1fe-c159-4c88-8799-6424f062ce75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:26.708137 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeb1fe-c159-4c88-8799-6424f062ce75 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:26.708419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeb1fe-c159-4c88-8799-6424f062ce75 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:26.708694 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeb1fe-c159-4c88-8799-6424f062ce75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:26.719790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eeb1fe-c159-4c88-8799-6424f062ce75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:26.721220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eeb1fe-c159-4c88-8799-6424f062ce75 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:26.723710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:26.737314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-a2eeb1fe-c159-4c88-8799-6424f062ce75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:26.737314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:26.737314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:26.737314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:26.737314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:26.737314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:26.737314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:26.737314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:26.737314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:26.737314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:26.737314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:26.737314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:26.737314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:26.737314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:26.737314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:26.737314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:26.738542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:26.738542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:26.738542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:26.738542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:26.738542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:26.738542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:26.738542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:26.738542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:26.738542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:26.738542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:26.738542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:26.738542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:26.738542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:26.738542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:26.738542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:26.738542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:26.738542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:26.739438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:26.739438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:26.739438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:26.739438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 519/1050] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:26.745595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7707d-3689-4096-9690-8de044de50c7 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:26.852712 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7707d-3689-4096-9690-8de044de50c7 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:26.861943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:26.889571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c3316-5385-42a0-b844-c91ea5174ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:26.890205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c3316-5385-42a0-b844-c91ea5174ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:26.890489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c3316-5385-42a0-b844-c91ea5174ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:26.890767 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c3316-5385-42a0-b844-c91ea5174ef7 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:26.891410 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c3316-5385-42a0-b844-c91ea5174ef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:26.891715 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c3316-5385-42a0-b844-c91ea5174ef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:26.893082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c3316-5385-42a0-b844-c91ea5174ef7 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:26.910098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 532/1051] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:26.912513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeb1fe-c159-4c88-8799-6424f062ce75 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:27.017535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeb1fe-c159-4c88-8799-6424f062ce75 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:27.053954 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb676d7-ed3f-4ffe-9d68-45bdfc6382bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:27.054934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb676d7-ed3f-4ffe-9d68-45bdfc6382bc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:27.055363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb676d7-ed3f-4ffe-9d68-45bdfc6382bc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:27.055780 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb676d7-ed3f-4ffe-9d68-45bdfc6382bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:27.063758 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb676d7-ed3f-4ffe-9d68-45bdfc6382bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:27.065363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb676d7-ed3f-4ffe-9d68-45bdfc6382bc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:27.077379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5eb676d7-ed3f-4ffe-9d68-45bdfc6382bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:13:27.077379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:27.077379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:27.077379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:27.077379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:27.077379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:27.077379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:27.077379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:27.077379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:27.077379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:27.077379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:27.077379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:27.077379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:13:27.077379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:13:27.077379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:13:27.077379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:13:27.078441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:27.078441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:27.078441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:13:27.078441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:27.078441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:13:27.078441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:27.078441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:27.078441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:27.078441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:27.078441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:27.078441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:27.078441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:27.078441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:27.078441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:27.078441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:27.078441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:27.078441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:27.078441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:27.084402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:27.084402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:27.084402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:13:27.084402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:13:27.084402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:13:27.084402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:13:27.084402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:13:27.084402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:13:27.084402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:13:27.084402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:27.084402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 520/1052] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 23 16:13:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:27.085258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c3316-5385-42a0-b844-c91ea5174ef7 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:27.199501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c3316-5385-42a0-b844-c91ea5174ef7 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:27.235295 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671af3b-22ec-470d-890e-569384a95a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:27.235900 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671af3b-22ec-470d-890e-569384a95a10 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:27.236183 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671af3b-22ec-470d-890e-569384a95a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:27.236454 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671af3b-22ec-470d-890e-569384a95a10 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:27.237185 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671af3b-22ec-470d-890e-569384a95a10 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:27.237493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671af3b-22ec-470d-890e-569384a95a10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:27.238947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671af3b-22ec-470d-890e-569384a95a10 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:27.261497 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 533/1053] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 23 16:13:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:27.262762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb676d7-ed3f-4ffe-9d68-45bdfc6382bc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:27.320564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:27.365356 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb676d7-ed3f-4ffe-9d68-45bdfc6382bc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:27.399875 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be216d14-58e9-4741-94ad-0c327a0fe9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:27.400507 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be216d14-58e9-4741-94ad-0c327a0fe9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:27.400791 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be216d14-58e9-4741-94ad-0c327a0fe9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:27.401065 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be216d14-58e9-4741-94ad-0c327a0fe9d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:27.413592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be216d14-58e9-4741-94ad-0c327a0fe9d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:27.415209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be216d14-58e9-4741-94ad-0c327a0fe9d3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:27.430139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-be216d14-58e9-4741-94ad-0c327a0fe9d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:27.430139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:27.430139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:27.430139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:27.430139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:27.430139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:27.430139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:27.430139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:27.430139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:27.430139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:27.430139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:27.430139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:27.430139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:27.430139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:27.430139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:27.430139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:27.431122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:27.431122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:27.431122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:27.431122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:27.431122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:27.431122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:27.431122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:27.431122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:27.431122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:27.431122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:27.431122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:27.431122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:27.431122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:27.431122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:27.431122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:27.431122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:27.431122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:27.432031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:27.432031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:27.432031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:27.432213 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43fc86-6b81-4c74-8671-bcd76174f2a7 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:27.432287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 521/1054] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:27.432354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43fc86-6b81-4c74-8671-bcd76174f2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:27.432354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43fc86-6b81-4c74-8671-bcd76174f2a7 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:27.437334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 534/1055] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:27.441923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43fc86-6b81-4c74-8671-bcd76174f2a7 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:27.442040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af9159-3f5d-462e-8dd5-44408b16dc31 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:27.442040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af9159-3f5d-462e-8dd5-44408b16dc31 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:27.442040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af9159-3f5d-462e-8dd5-44408b16dc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:27.457248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a8af9159-3f5d-462e-8dd5-44408b16dc31 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:27.458469 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a8af9159-3f5d-462e-8dd5-44408b16dc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:27.471311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:27.532309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 522/1056] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:27.553153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43fc86-6b81-4c74-8671-bcd76174f2a7 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:27.588292 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f9390-b500-4aec-a142-6815214f791f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:27.588822 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f9390-b500-4aec-a142-6815214f791f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:27.589102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f9390-b500-4aec-a142-6815214f791f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:27.589368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f9390-b500-4aec-a142-6815214f791f None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:27.590008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f9390-b500-4aec-a142-6815214f791f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:27.590349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f9390-b500-4aec-a142-6815214f791f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:27.591709 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f9390-b500-4aec-a142-6815214f791f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:27.608008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 535/1057] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:27.609433 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af9159-3f5d-462e-8dd5-44408b16dc31 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:27.649254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:27.711207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af9159-3f5d-462e-8dd5-44408b16dc31 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:27.744371 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6572159-cc8c-43f4-a34f-ae75a585ab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:27.745000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6572159-cc8c-43f4-a34f-ae75a585ab2a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:27.745279 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6572159-cc8c-43f4-a34f-ae75a585ab2a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:27.745547 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6572159-cc8c-43f4-a34f-ae75a585ab2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:27.752158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6572159-cc8c-43f4-a34f-ae75a585ab2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:27.753596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6572159-cc8c-43f4-a34f-ae75a585ab2a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:27.764499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e6572159-cc8c-43f4-a34f-ae75a585ab2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:27.764499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:27.764499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:27.764499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:27.764499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:27.764499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:27.764499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:27.764499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:27.764499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:27.764499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:27.764499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:27.764499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:27.764499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:13:27.764499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:13:27.764499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:13:27.765383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:13:27.765383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:27.765383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:27.765383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:27.765383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:27.765383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:27.765383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:27.765383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:27.765383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:27.765383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:27.765383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:27.765383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:27.765383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:27.765383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:27.765383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:27.765383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:27.765383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:27.771492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:13:27.771492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:13:27.771492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:13:27.771492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:13:27.771492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:13:27.771492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:13:27.771492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:27.771492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:27.771492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 523/1058] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:13:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:27.771978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f9390-b500-4aec-a142-6815214f791f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:27.802202 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6572159-cc8c-43f4-a34f-ae75a585ab2a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:27.862836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:27.878019 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f9390-b500-4aec-a142-6815214f791f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:27.911879 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:27.913764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c75a3d-300c-4ed4-8e34-07c2f8cb4bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:27.914569 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c75a3d-300c-4ed4-8e34-07c2f8cb4bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:27.914856 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c75a3d-300c-4ed4-8e34-07c2f8cb4bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:27.915131 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c75a3d-300c-4ed4-8e34-07c2f8cb4bd2 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:27.915827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c75a3d-300c-4ed4-8e34-07c2f8cb4bd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:27.916181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c75a3d-300c-4ed4-8e34-07c2f8cb4bd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:27.917553 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c75a3d-300c-4ed4-8e34-07c2f8cb4bd2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:27.918794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6572159-cc8c-43f4-a34f-ae75a585ab2a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:27.929691 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 536/1059] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:13:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:27.935572 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c75a3d-300c-4ed4-8e34-07c2f8cb4bd2 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:27.955640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a91668-e49d-4fd0-9ed2-e0f7f6c97b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:27.956562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a91668-e49d-4fd0-9ed2-e0f7f6c97b15 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:27.957128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a91668-e49d-4fd0-9ed2-e0f7f6c97b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:27.957399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a91668-e49d-4fd0-9ed2-e0f7f6c97b15 None admin] PATH_INFO: `/v3/services/image` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:27.957978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a91668-e49d-4fd0-9ed2-e0f7f6c97b15 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:27.959358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a91668-e49d-4fd0-9ed2-e0f7f6c97b15 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:27.969167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-61a91668-e49d-4fd0-9ed2-e0f7f6c97b15 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:13:27.969167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:27.969167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:13:27.969167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:13:27.969167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:13:27.969167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:13:27.969167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:13:27.969167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:27.969167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:13:27.969167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:27.969167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:13:27.969167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:27.969167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:27.969167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:27.969167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:27.969167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:27.969167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:27.970220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:27.970220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:27.970220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:27.970220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:27.970220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:27.970220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:27.970220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:13:27.970220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:13:27.970220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:13:27.970220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:13:27.970220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:27.970220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:27.970220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:27.970220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:27.970220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:27.970220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:27.971725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:27.971725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:27.971725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:27.971725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:27.971725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:27.971725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:27.971725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:27.971725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:27.971725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:27.971725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:27.971725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:13:27.971725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:13:27.971725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 16:13:27.971725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:27.971725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 524/1060] 10.222.0.16 () {56 vars in 1105 bytes} [Tue Aug 23 16:13:27 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:27.976810 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a91668-e49d-4fd0-9ed2-e0f7f6c97b15 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:28.040664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c75a3d-300c-4ed4-8e34-07c2f8cb4bd2 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:28.074674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ab8a9-7cbb-4929-b86f-2644ddca7025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:28.075324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ab8a9-7cbb-4929-b86f-2644ddca7025 None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:28.075449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a91668-e49d-4fd0-9ed2-e0f7f6c97b15 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:28.075605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ab8a9-7cbb-4929-b86f-2644ddca7025 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:28.075880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ab8a9-7cbb-4929-b86f-2644ddca7025 None admin] PATH_INFO: `/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/767ca33ca8e244f8a0cc773e3b6abefb/roles/361e9c2a98ae4a7f925cd3ec46baf425` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:28.078132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ab8a9-7cbb-4929-b86f-2644ddca7025 None admin] RBAC: Authorizing `identity:create_grant(project_id=15a0439c9dd3406f81e2740fe775782b, user_id=767ca33ca8e244f8a0cc773e3b6abefb, role_id=361e9c2a98ae4a7f925cd3ec46baf425)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:28.079565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ab8a9-7cbb-4929-b86f-2644ddca7025 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:28.092843 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 537/1061] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:13:27 2022] PUT /identity/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/767ca33ca8e244f8a0cc773e3b6abefb/roles/361e9c2a98ae4a7f925cd3ec46baf425 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:13:28.106401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a6bc1-7a3d-4d22-8d65-bff5da68e47d None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:28.106401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a6bc1-7a3d-4d22-8d65-bff5da68e47d None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:28.106401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a6bc1-7a3d-4d22-8d65-bff5da68e47d None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:28.106401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 538/1062] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:28.106401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8520b-cd78-4066-86bd-83643d7fecd2 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:28.106401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8520b-cd78-4066-86bd-83643d7fecd2 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:28.106846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8520b-cd78-4066-86bd-83643d7fecd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:28.112470 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076c062-f7cc-4c81-a3d4-dd6071ee924c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:28.113156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076c062-f7cc-4c81-a3d4-dd6071ee924c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:28.113376 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076c062-f7cc-4c81-a3d4-dd6071ee924c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:28.113645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076c062-f7cc-4c81-a3d4-dd6071ee924c None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:28.114320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076c062-f7cc-4c81-a3d4-dd6071ee924c None admin] RBAC: Adding query filter params (name=image) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:28.114621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076c062-f7cc-4c81-a3d4-dd6071ee924c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:28.116629 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076c062-f7cc-4c81-a3d4-dd6071ee924c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:28.117014 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:28.127682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 525/1063] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:28.127882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-ddd8520b-cd78-4066-86bd-83643d7fecd2 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:28.127882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ddd8520b-cd78-4066-86bd-83643d7fecd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:28.128867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076c062-f7cc-4c81-a3d4-dd6071ee924c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:28.169116 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:28.219850 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 539/1064] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:13:28.277392 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076c062-f7cc-4c81-a3d4-dd6071ee924c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:28.312244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a0fcd-59d7-4696-bc42-a84cdc8110cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:28.312848 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a0fcd-59d7-4696-bc42-a84cdc8110cc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:28.313125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a0fcd-59d7-4696-bc42-a84cdc8110cc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:28.313394 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a0fcd-59d7-4696-bc42-a84cdc8110cc None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:28.314026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a0fcd-59d7-4696-bc42-a84cdc8110cc None admin] RBAC: Adding query filter params (type=image) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:28.314355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a0fcd-59d7-4696-bc42-a84cdc8110cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:28.315698 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a0fcd-59d7-4696-bc42-a84cdc8110cc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:28.326055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 526/1065] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:28.327287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8520b-cd78-4066-86bd-83643d7fecd2 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:28.431073 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8520b-cd78-4066-86bd-83643d7fecd2 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:28.466124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a43106-afc0-4bc2-9251-cb4e3a43c030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:28.466731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a43106-afc0-4bc2-9251-cb4e3a43c030 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:28.467008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a43106-afc0-4bc2-9251-cb4e3a43c030 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:28.467277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a43106-afc0-4bc2-9251-cb4e3a43c030 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:28.467938 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a43106-afc0-4bc2-9251-cb4e3a43c030 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:28.469293 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a43106-afc0-4bc2-9251-cb4e3a43c030 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:28.474662 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:28.496158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 540/1066] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 16:13:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:13:28.497671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a0fcd-59d7-4696-bc42-a84cdc8110cc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:28.604153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:28.615696 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a0fcd-59d7-4696-bc42-a84cdc8110cc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:28.660104 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0e0df-21b1-4aca-8a93-f45c84329e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:28.660738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0e0df-21b1-4aca-8a93-f45c84329e91 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:28.661016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0e0df-21b1-4aca-8a93-f45c84329e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:28.661291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0e0df-21b1-4aca-8a93-f45c84329e91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:28.673084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0e0df-21b1-4aca-8a93-f45c84329e91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:13:28.677721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-ebe0e0df-21b1-4aca-8a93-f45c84329e91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:13:28.677721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:28.677721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:28.677721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:28.677721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:28.677721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:28.677721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:28.677721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:28.677721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:28.677721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:28.677721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:28.677721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:28.677721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:13:28.677721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:13:28.677721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:13:28.677721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:13:28.678993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:13:28.678993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:13:28.678993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:13:28.678993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:13:28.678993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:28.678993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:28.678993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:28.678993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:28.678993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:28.678993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:28.678993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:28.678993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:28.678993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:28.678993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:28.678993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:28.678993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:28.680489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:28.680489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:28.680489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:28.680489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:28.680489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:13:28.680489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:13:28.680489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:13:28.680489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:13:28.680489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:13:28.680489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:13:28.680489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:13:28.680489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:28.680489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 527/1067] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:13:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:28.685048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a43106-afc0-4bc2-9251-cb4e3a43c030 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:28.791000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a43106-afc0-4bc2-9251-cb4e3a43c030 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:28.825716 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eefd0d-b6da-4887-8a70-f5657ec6e59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:28.826357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eefd0d-b6da-4887-8a70-f5657ec6e59d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:28.826638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eefd0d-b6da-4887-8a70-f5657ec6e59d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:28.826909 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eefd0d-b6da-4887-8a70-f5657ec6e59d None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:28.827574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eefd0d-b6da-4887-8a70-f5657ec6e59d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:28.827876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eefd0d-b6da-4887-8a70-f5657ec6e59d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:28.829242 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eefd0d-b6da-4887-8a70-f5657ec6e59d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:28.840182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 541/1068] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:13:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:28.845848 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0e0df-21b1-4aca-8a93-f45c84329e91 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:28.949686 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0e0df-21b1-4aca-8a93-f45c84329e91 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:28.987474 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e1885-ade8-4d8d-b759-8c765c6da619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:28.988273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e1885-ade8-4d8d-b759-8c765c6da619 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:28.988550 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e1885-ade8-4d8d-b759-8c765c6da619 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:28.988820 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e1885-ade8-4d8d-b759-8c765c6da619 None admin] PATH_INFO: `/v3/users/93bd511515fe488bbd71aee2b5cf937c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:29.003245 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e1885-ade8-4d8d-b759-8c765c6da619 None admin] RBAC: Authorizing `identity:get_user(user_id=93bd511515fe488bbd71aee2b5cf937c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:29.004664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e1885-ade8-4d8d-b759-8c765c6da619 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:29.006554 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 528/1069] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:13:28 2022] GET /identity/v3/users/93bd511515fe488bbd71aee2b5cf937c => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:29.012656 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eefd0d-b6da-4887-8a70-f5657ec6e59d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:29.072155 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:29.121074 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eefd0d-b6da-4887-8a70-f5657ec6e59d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:29.155637 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71395043-26de-4118-8d22-8a97753d027a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:29.156240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71395043-26de-4118-8d22-8a97753d027a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:29.156518 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71395043-26de-4118-8d22-8a97753d027a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:29.156789 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71395043-26de-4118-8d22-8a97753d027a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:29.233034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71395043-26de-4118-8d22-8a97753d027a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:29.234429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71395043-26de-4118-8d22-8a97753d027a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:29.288461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:29.335607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 542/1070] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:13:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:13:29.341239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e1885-ade8-4d8d-b759-8c765c6da619 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:29.344957 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:29.442785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e1885-ade8-4d8d-b759-8c765c6da619 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:29.476538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413bbbc-3920-483b-8f34-96a432f93929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:29.477284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413bbbc-3920-483b-8f34-96a432f93929 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:29.477571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413bbbc-3920-483b-8f34-96a432f93929 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:29.477874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413bbbc-3920-483b-8f34-96a432f93929 None admin] PATH_INFO: `/v3/projects/79846aeecb934a49bc4e37b785853104` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:29.479007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413bbbc-3920-483b-8f34-96a432f93929 None admin] RBAC: Authorizing `identity:get_project(project_id=79846aeecb934a49bc4e37b785853104)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:29.480436 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413bbbc-3920-483b-8f34-96a432f93929 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:29.487122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 529/1071] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:13:29 2022] GET /identity/v3/projects/79846aeecb934a49bc4e37b785853104 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:29.488306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71395043-26de-4118-8d22-8a97753d027a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:29.591742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71395043-26de-4118-8d22-8a97753d027a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:29.628100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18811bee-8e30-4cce-ba0a-d96c5ad75ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:29.628712 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18811bee-8e30-4cce-ba0a-d96c5ad75ffe None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:29.628992 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18811bee-8e30-4cce-ba0a-d96c5ad75ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:29.629264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18811bee-8e30-4cce-ba0a-d96c5ad75ffe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:29.629996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18811bee-8e30-4cce-ba0a-d96c5ad75ffe None admin] RBAC: Adding query filter params (role.id=8de0c87242d7426ea25a510b578c02aa, scope.project.id=79846aeecb934a49bc4e37b785853104, user.id=93bd511515fe488bbd71aee2b5cf937c) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:29.630335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18811bee-8e30-4cce-ba0a-d96c5ad75ffe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:29.632478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18811bee-8e30-4cce-ba0a-d96c5ad75ffe None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:29.646115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 543/1072] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:13:29 2022] GET /identity/v3/role_assignments?user.id=93bd511515fe488bbd71aee2b5cf937c&scope.project.id=79846aeecb934a49bc4e37b785853104&role.id=8de0c87242d7426ea25a510b578c02aa => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:30.069562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dc019-1191-449c-bf66-539ffe3a8e76 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:30.070107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dc019-1191-449c-bf66-539ffe3a8e76 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:30.070107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dc019-1191-449c-bf66-539ffe3a8e76 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:30.071635 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 530/1073] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:30.076760 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa2db4-69a1-434c-bb1d-cc5a648563e4 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:30.077148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa2db4-69a1-434c-bb1d-cc5a648563e4 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:30.077326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa2db4-69a1-434c-bb1d-cc5a648563e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:30.095359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-c7fa2db4-69a1-434c-bb1d-cc5a648563e4 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:30.096551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c7fa2db4-69a1-434c-bb1d-cc5a648563e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:30.111515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:30.178330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 544/1074] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:30.446823 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dc019-1191-449c-bf66-539ffe3a8e76 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:30.450038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edde86-be9f-4001-b2ad-3f34280eb5c7 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:30.450356 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edde86-be9f-4001-b2ad-3f34280eb5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:30.451430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edde86-be9f-4001-b2ad-3f34280eb5c7 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:30.451963 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 545/1075] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:30.457586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819a16a-fc1e-485e-b324-677bc35f1706 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:30.457867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819a16a-fc1e-485e-b324-677bc35f1706 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:30.458380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819a16a-fc1e-485e-b324-677bc35f1706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:30.478052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-6819a16a-fc1e-485e-b324-677bc35f1706 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:30.479265 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6819a16a-fc1e-485e-b324-677bc35f1706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:30.521497 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:30.551840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 546/1076] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:30.557290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dc019-1191-449c-bf66-539ffe3a8e76 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:30.591723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a844c-c6d8-40b3-841c-6196558185bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:30.592355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a844c-c6d8-40b3-841c-6196558185bc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:30.592632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a844c-c6d8-40b3-841c-6196558185bc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:30.592915 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a844c-c6d8-40b3-841c-6196558185bc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:30.603783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a844c-c6d8-40b3-841c-6196558185bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:13:30.608423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-443a844c-c6d8-40b3-841c-6196558185bc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:13:30.608423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:30.608423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:30.608423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:30.608423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:30.608423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:30.608423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:30.608423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:30.608423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:30.608423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:30.608423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:30.608423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:30.608423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:13:30.608423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:13:30.608423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:13:30.608423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:13:30.609328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:13:30.609328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:13:30.609328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:13:30.609328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:13:30.609328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:30.609328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:30.609328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:30.609328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:30.609328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:30.609328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:30.609328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:30.609328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:30.609328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:30.609328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:30.609328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:30.609328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:30.610730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:30.610730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:30.610730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:30.610730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:30.610730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:13:30.610730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:13:30.610730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:13:30.610730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:13:30.610730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:13:30.610730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:13:30.610730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 16:13:30.610730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:30.610730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 531/1077] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 23 16:13:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:30.615499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819a16a-fc1e-485e-b324-677bc35f1706 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:30.697675 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:30.723670 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819a16a-fc1e-485e-b324-677bc35f1706 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:30.758679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb3cb1-cb5f-477e-882a-6935d2c2193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:30.759285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb3cb1-cb5f-477e-882a-6935d2c2193e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:30.759564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb3cb1-cb5f-477e-882a-6935d2c2193e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:30.759833 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb3cb1-cb5f-477e-882a-6935d2c2193e None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:30.760492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb3cb1-cb5f-477e-882a-6935d2c2193e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:30.760794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb3cb1-cb5f-477e-882a-6935d2c2193e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:30.762177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb3cb1-cb5f-477e-882a-6935d2c2193e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:30.770287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 547/1078] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 23 16:13:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:30.776464 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a844c-c6d8-40b3-841c-6196558185bc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:30.821282 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb3cb1-cb5f-477e-882a-6935d2c2193e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:30.880182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a844c-c6d8-40b3-841c-6196558185bc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:30.913194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:30.919647 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0089e5-37b6-4706-82bc-5080e189f3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:30.920898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0089e5-37b6-4706-82bc-5080e189f3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:30.921086 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0089e5-37b6-4706-82bc-5080e189f3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:30.921347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0089e5-37b6-4706-82bc-5080e189f3e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:30.930388 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb3cb1-cb5f-477e-882a-6935d2c2193e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:30.933407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0089e5-37b6-4706-82bc-5080e189f3e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:30.934248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0089e5-37b6-4706-82bc-5080e189f3e4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:30.948950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-7e0089e5-37b6-4706-82bc-5080e189f3e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:30.948950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:30.948950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:30.948950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:30.948950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:30.948950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:30.948950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:30.948950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:30.948950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:30.948950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:30.948950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:30.948950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:30.948950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:30.948950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:30.948950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:30.948950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:30.949913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:30.949913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:30.949913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:30.949913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:30.949913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:30.949913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:30.949913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:30.949913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:30.949913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:30.949913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:30.949913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:30.949913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:30.949913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:30.949913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:30.949913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:30.949913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:30.949913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:30.955961 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:30.955961 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:30.955961 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:30.955961 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 532/1079] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:30.955961 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0089e5-37b6-4706-82bc-5080e189f3e4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:30.973485 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348aebc6-e4d2-465d-b3ee-11dbcd969164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:30.974127 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aebc6-e4d2-465d-b3ee-11dbcd969164 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:30.974410 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aebc6-e4d2-465d-b3ee-11dbcd969164 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:30.974688 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aebc6-e4d2-465d-b3ee-11dbcd969164 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:30.986361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:31.051086 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348aebc6-e4d2-465d-b3ee-11dbcd969164 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:31.052561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348aebc6-e4d2-465d-b3ee-11dbcd969164 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:31.063445 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0089e5-37b6-4706-82bc-5080e189f3e4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:31.098271 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046116d9-a74a-41a6-a312-4dcf1f8c5a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:31.098939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046116d9-a74a-41a6-a312-4dcf1f8c5a10 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:31.099210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046116d9-a74a-41a6-a312-4dcf1f8c5a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:31.099485 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046116d9-a74a-41a6-a312-4dcf1f8c5a10 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:31.100131 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046116d9-a74a-41a6-a312-4dcf1f8c5a10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:31.101111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046116d9-a74a-41a6-a312-4dcf1f8c5a10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:31.102722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046116d9-a74a-41a6-a312-4dcf1f8c5a10 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:31.118225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 533/1080] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:31.121370 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046116d9-a74a-41a6-a312-4dcf1f8c5a10 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:31.168776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:31.182218 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 548/1081] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:13:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 16:13:31.186253 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348aebc6-e4d2-465d-b3ee-11dbcd969164 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:31.232076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046116d9-a74a-41a6-a312-4dcf1f8c5a10 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:31.235267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:31.268957 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0f417-3709-4dc8-8039-6e509ceb88b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:31.269588 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0f417-3709-4dc8-8039-6e509ceb88b8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:31.269869 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0f417-3709-4dc8-8039-6e509ceb88b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:31.270165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d0f417-3709-4dc8-8039-6e509ceb88b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:31.277393 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0f417-3709-4dc8-8039-6e509ceb88b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:31.278853 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d0f417-3709-4dc8-8039-6e509ceb88b8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:31.291805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-c5d0f417-3709-4dc8-8039-6e509ceb88b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:13:31.291805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:31.291805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:31.291805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:31.291805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:31.291805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:31.291805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:31.291805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:31.291805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:31.291805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:31.291805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:31.291805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:31.291805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:13:31.291805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:13:31.291805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:13:31.291805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:13:31.292787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:31.292787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:31.292787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:13:31.292787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:31.292787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:13:31.292787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:13:31.292787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:31.292787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:31.292787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:31.292787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:31.292787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:31.292787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:31.292787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:31.292787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:31.292787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:31.292787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:31.292787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:31.292787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:31.293735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:31.293735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:31.293735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:13:31.293735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:13:31.293735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:13:31.293735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:13:31.293735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:13:31.293735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:13:31.293735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 16:13:31.293735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:31.295243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 534/1082] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 23 16:13:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:31.300865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0f417-3709-4dc8-8039-6e509ceb88b8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:31.307159 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348aebc6-e4d2-465d-b3ee-11dbcd969164 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:31.347216 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a1f9a-00c3-452d-9c19-0ffccb8d6d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:31.347990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a1f9a-00c3-452d-9c19-0ffccb8d6d1c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:31.348266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a1f9a-00c3-452d-9c19-0ffccb8d6d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:31.348559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a1f9a-00c3-452d-9c19-0ffccb8d6d1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:31.359203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a1f9a-00c3-452d-9c19-0ffccb8d6d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:31.360639 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a1f9a-00c3-452d-9c19-0ffccb8d6d1c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:31.375106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-ad9a1f9a-00c3-452d-9c19-0ffccb8d6d1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:31.375106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:31.375106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:31.375106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:31.375106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:31.375106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:31.375106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:31.375106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:31.375106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:31.375106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:31.375106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:31.375106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:31.375106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:31.375106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:31.375106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:31.375106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:31.376079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:31.376079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:31.376079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:31.376079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:31.376079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:31.376079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:31.376079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:31.376079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:31.376079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:31.376079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:31.376079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:31.376079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:31.376079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:31.376079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:31.376079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:31.376079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:31.376079 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:31.376997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:31.376997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:31.376997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:31.376997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 549/1083] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:31.382130 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a1f9a-00c3-452d-9c19-0ffccb8d6d1c None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:31.414375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d0f417-3709-4dc8-8039-6e509ceb88b8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:31.417462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:31.451851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e996f9-552c-4a6a-b260-d59bd3bbcf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:31.452466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e996f9-552c-4a6a-b260-d59bd3bbcf7c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:31.452747 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e996f9-552c-4a6a-b260-d59bd3bbcf7c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:31.453025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e996f9-552c-4a6a-b260-d59bd3bbcf7c None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:31.453760 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e996f9-552c-4a6a-b260-d59bd3bbcf7c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:31.454090 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e996f9-552c-4a6a-b260-d59bd3bbcf7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:31.455515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e996f9-552c-4a6a-b260-d59bd3bbcf7c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:31.480356 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 535/1084] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 23 16:13:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:31.481435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e996f9-552c-4a6a-b260-d59bd3bbcf7c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:31.485769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:31.498023 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a1f9a-00c3-452d-9c19-0ffccb8d6d1c None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:31.539680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d2b5c-fbf9-4267-bbbc-8e19cb96d75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:31.540421 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d2b5c-fbf9-4267-bbbc-8e19cb96d75a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:31.540704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d2b5c-fbf9-4267-bbbc-8e19cb96d75a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:31.540977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d2b5c-fbf9-4267-bbbc-8e19cb96d75a None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:31.541623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d2b5c-fbf9-4267-bbbc-8e19cb96d75a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:31.541931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d2b5c-fbf9-4267-bbbc-8e19cb96d75a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:31.543571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d2b5c-fbf9-4267-bbbc-8e19cb96d75a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:31.564787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 550/1085] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:31.564787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fd283-97f5-460e-9beb-21a7807ee809 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:31.564787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fd283-97f5-460e-9beb-21a7807ee809 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:31.564787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fd283-97f5-460e-9beb-21a7807ee809 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:31.564787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 551/1086] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:31.567076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb736a-9d04-4663-b77d-689a6ddc2a43 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:31.567360 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb736a-9d04-4663-b77d-689a6ddc2a43 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:31.567669 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb736a-9d04-4663-b77d-689a6ddc2a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:31.589945 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-2ddb736a-9d04-4663-b77d-689a6ddc2a43 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:31.591219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-2ddb736a-9d04-4663-b77d-689a6ddc2a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:31.593561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e996f9-552c-4a6a-b260-d59bd3bbcf7c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:31.632337 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f5951-9d23-4a99-953a-caac40c024df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:31.633227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f5951-9d23-4a99-953a-caac40c024df None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:31.633510 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f5951-9d23-4a99-953a-caac40c024df None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:31.633781 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f5951-9d23-4a99-953a-caac40c024df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:31.666760 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:31.668688 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 552/1087] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:13:31.715395 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f5951-9d23-4a99-953a-caac40c024df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:31.716855 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f5951-9d23-4a99-953a-caac40c024df None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:31.824611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 536/1088] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:13:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:13:31.830988 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb736a-9d04-4663-b77d-689a6ddc2a43 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:31.913429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:31.931896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb736a-9d04-4663-b77d-689a6ddc2a43 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:31.938335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f5951-9d23-4a99-953a-caac40c024df None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:31.966690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5988f4-9e19-49d5-911f-cab4a87f3ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:31.967318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5988f4-9e19-49d5-911f-cab4a87f3ffb None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:31.967606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5988f4-9e19-49d5-911f-cab4a87f3ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:31.967884 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5988f4-9e19-49d5-911f-cab4a87f3ffb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:31.977873 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5988f4-9e19-49d5-911f-cab4a87f3ffb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:31.979353 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5988f4-9e19-49d5-911f-cab4a87f3ffb None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:31.993918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-6c5988f4-9e19-49d5-911f-cab4a87f3ffb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:31.993918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:31.993918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:31.993918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:31.993918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:31.993918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:31.993918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:31.993918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:31.993918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:31.993918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:31.993918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:31.993918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:31.993918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:13:31.993918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:13:31.993918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:13:31.993918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:13:31.994921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:31.994921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:31.994921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:31.994921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:31.994921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:31.994921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:31.994921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:31.994921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:31.994921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:31.994921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:31.994921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:31.994921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:31.994921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:31.994921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:31.994921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:31.994921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:31.994921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:13:31.995947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:13:31.995947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:13:31.995947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:31.995947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 553/1089] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:31.998418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:32.000932 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5988f4-9e19-49d5-911f-cab4a87f3ffb None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:32.037296 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f5951-9d23-4a99-953a-caac40c024df None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:32.071143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c75b8-51b9-41a3-94df-ca6de70b10fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:32.071764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c75b8-51b9-41a3-94df-ca6de70b10fd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:32.072041 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c75b8-51b9-41a3-94df-ca6de70b10fd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:32.072310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c75b8-51b9-41a3-94df-ca6de70b10fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:32.082183 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c75b8-51b9-41a3-94df-ca6de70b10fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:13:32.087462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-c01c75b8-51b9-41a3-94df-ca6de70b10fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:13:32.087462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:32.087462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:32.087462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:32.087462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:32.087462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:32.087462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:32.087462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:32.087462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:32.087462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:32.087462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:32.087462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:32.087462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:13:32.087462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:13:32.087462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:13:32.087462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:13:32.088561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:13:32.088561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:13:32.088561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:13:32.088561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:13:32.088561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:32.088561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:32.088561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:32.088561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:32.088561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:32.088561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:32.088561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:32.088561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:32.088561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:32.088561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:32.088561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:32.088561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:32.089425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:32.089425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:32.089425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:32.089425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:32.089425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:13:32.089425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:13:32.089425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:13:32.089425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:13:32.089425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:13:32.089425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:13:32.089425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:13:32.089425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:13:32.089425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 537/1090] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:13:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:32.094603 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c75b8-51b9-41a3-94df-ca6de70b10fd None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:32.101816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5988f4-9e19-49d5-911f-cab4a87f3ffb None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:32.139162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b94ca-3217-441f-96f3-9b3c8260c367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:32.139766 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b94ca-3217-441f-96f3-9b3c8260c367 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:32.140048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b94ca-3217-441f-96f3-9b3c8260c367 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:32.140323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b94ca-3217-441f-96f3-9b3c8260c367 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:32.140965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b94ca-3217-441f-96f3-9b3c8260c367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:32.141268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b94ca-3217-441f-96f3-9b3c8260c367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:32.142674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b94ca-3217-441f-96f3-9b3c8260c367 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:32.144082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:32.154886 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 554/1091] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:32.160741 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b94ca-3217-441f-96f3-9b3c8260c367 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:32.205175 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c75b8-51b9-41a3-94df-ca6de70b10fd None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:32.228575 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:32.240116 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95be64-aaf3-4a54-8495-5279227ef6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:32.241233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95be64-aaf3-4a54-8495-5279227ef6ee None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:32.241713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95be64-aaf3-4a54-8495-5279227ef6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:32.242205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95be64-aaf3-4a54-8495-5279227ef6ee None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:32.242879 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95be64-aaf3-4a54-8495-5279227ef6ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:32.243179 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95be64-aaf3-4a54-8495-5279227ef6ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:32.244525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95be64-aaf3-4a54-8495-5279227ef6ee None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:32.252723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 538/1092] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:13:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:32.259321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95be64-aaf3-4a54-8495-5279227ef6ee None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:32.263037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b94ca-3217-441f-96f3-9b3c8260c367 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:32.298709 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435ef1d-0b13-489b-9777-e0e63aba4c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:32.299334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435ef1d-0b13-489b-9777-e0e63aba4c45 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:32.299615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435ef1d-0b13-489b-9777-e0e63aba4c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:32.299884 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435ef1d-0b13-489b-9777-e0e63aba4c45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:32.306887 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435ef1d-0b13-489b-9777-e0e63aba4c45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:32.308310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435ef1d-0b13-489b-9777-e0e63aba4c45 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:32.319765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-d435ef1d-0b13-489b-9777-e0e63aba4c45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:32.319765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:32.319765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:32.319765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:32.319765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:32.319765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:32.319765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:32.319765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:32.319765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:32.319765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:32.319765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:32.319765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:32.319765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:13:32.319765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:13:32.319765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:13:32.320951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:13:32.320951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:32.320951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:32.320951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:32.320951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:32.320951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:32.320951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:32.320951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:32.320951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:32.320951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:32.320951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:32.320951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:32.320951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:32.320951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:32.320951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:32.320951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:32.320951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:32.322422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:13:32.322422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:13:32.322422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:13:32.322422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:13:32.322422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:13:32.322422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:13:32.322422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:13:32.322422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:32.322422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 555/1093] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:13:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:13:32.326656 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435ef1d-0b13-489b-9777-e0e63aba4c45 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:32.361179 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95be64-aaf3-4a54-8495-5279227ef6ee None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:32.383025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:32.394331 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e49b8-59d9-4523-8cb6-ba356455dd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:32.395038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e49b8-59d9-4523-8cb6-ba356455dd65 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:32.395314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e49b8-59d9-4523-8cb6-ba356455dd65 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:32.395584 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e49b8-59d9-4523-8cb6-ba356455dd65 None admin] PATH_INFO: `/v3/users/93bd511515fe488bbd71aee2b5cf937c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:32.396725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e49b8-59d9-4523-8cb6-ba356455dd65 None admin] RBAC: Authorizing `identity:get_user(user_id=93bd511515fe488bbd71aee2b5cf937c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:32.398687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e49b8-59d9-4523-8cb6-ba356455dd65 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:32.400311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 539/1094] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:13:32 2022] GET /identity/v3/users/93bd511515fe488bbd71aee2b5cf937c => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:32.405966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e49b8-59d9-4523-8cb6-ba356455dd65 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:32.430105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435ef1d-0b13-489b-9777-e0e63aba4c45 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:32.457672 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:32.463619 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3ee1d-d6b0-4305-9085-6f4f300df0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:32.464223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3ee1d-d6b0-4305-9085-6f4f300df0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:32.464496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3ee1d-d6b0-4305-9085-6f4f300df0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:32.464763 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3ee1d-d6b0-4305-9085-6f4f300df0c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:32.465443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3ee1d-d6b0-4305-9085-6f4f300df0c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:32.465744 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3ee1d-d6b0-4305-9085-6f4f300df0c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:32.467246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3ee1d-d6b0-4305-9085-6f4f300df0c3 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:32.480154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 556/1095] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:13:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:32.486120 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3ee1d-d6b0-4305-9085-6f4f300df0c3 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:32.508174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e49b8-59d9-4523-8cb6-ba356455dd65 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:32.542440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ef9ae-d64b-42ad-a92d-c58b7b641bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:32.543054 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ef9ae-d64b-42ad-a92d-c58b7b641bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:32.543334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ef9ae-d64b-42ad-a92d-c58b7b641bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:32.543603 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ef9ae-d64b-42ad-a92d-c58b7b641bc0 None admin] PATH_INFO: `/v3/projects/79846aeecb934a49bc4e37b785853104` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:32.544700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ef9ae-d64b-42ad-a92d-c58b7b641bc0 None admin] RBAC: Authorizing `identity:get_project(project_id=79846aeecb934a49bc4e37b785853104)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:32.546136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ef9ae-d64b-42ad-a92d-c58b7b641bc0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:32.547901 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 540/1096] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:13:32 2022] GET /identity/v3/projects/79846aeecb934a49bc4e37b785853104 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:32.554504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ef9ae-d64b-42ad-a92d-c58b7b641bc0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:32.591578 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3ee1d-d6b0-4305-9085-6f4f300df0c3 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:32.605525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:32.626093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f26e79-2379-4507-97aa-a043892ab85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:32.626620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f26e79-2379-4507-97aa-a043892ab85a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:32.626896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f26e79-2379-4507-97aa-a043892ab85a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:32.627162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f26e79-2379-4507-97aa-a043892ab85a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:32.627875 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f26e79-2379-4507-97aa-a043892ab85a None admin] RBAC: Adding query filter params (role.id=361e9c2a98ae4a7f925cd3ec46baf425, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=767ca33ca8e244f8a0cc773e3b6abefb) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:32.628177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f26e79-2379-4507-97aa-a043892ab85a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:32.629595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f26e79-2379-4507-97aa-a043892ab85a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:32.636319 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 557/1097] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:13:32 2022] GET /identity/v3/role_assignments?user.id=767ca33ca8e244f8a0cc773e3b6abefb&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=361e9c2a98ae4a7f925cd3ec46baf425 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:13:32.657374 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ef9ae-d64b-42ad-a92d-c58b7b641bc0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:32.680057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:32.695755 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130517d-362b-418a-a96b-14e4c81e2be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:32.696454 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130517d-362b-418a-a96b-14e4c81e2be1 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:32.696738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130517d-362b-418a-a96b-14e4c81e2be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:32.697015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130517d-362b-418a-a96b-14e4c81e2be1 None admin] PATH_INFO: `/v3/projects/79846aeecb934a49bc4e37b785853104/users/93bd511515fe488bbd71aee2b5cf937c/roles/8de0c87242d7426ea25a510b578c02aa` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:32.699111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130517d-362b-418a-a96b-14e4c81e2be1 None admin] RBAC: Authorizing `identity:create_grant(project_id=79846aeecb934a49bc4e37b785853104, user_id=93bd511515fe488bbd71aee2b5cf937c, role_id=8de0c87242d7426ea25a510b578c02aa)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:32.700569 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130517d-362b-418a-a96b-14e4c81e2be1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:32.715367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 541/1098] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:13:32 2022] PUT /identity/v3/projects/79846aeecb934a49bc4e37b785853104/users/93bd511515fe488bbd71aee2b5cf937c/roles/8de0c87242d7426ea25a510b578c02aa => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:13:34.647642 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480bf88-1a7f-4b5b-8dbc-8a564e54cf99 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:34.648173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480bf88-1a7f-4b5b-8dbc-8a564e54cf99 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:34.648173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480bf88-1a7f-4b5b-8dbc-8a564e54cf99 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:34.649515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 558/1099] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:34.654736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11f812-d351-4713-ac75-9c227383d959 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:34.655161 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11f812-d351-4713-ac75-9c227383d959 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:34.655286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11f812-d351-4713-ac75-9c227383d959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:34.673936 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ed11f812-d351-4713-ac75-9c227383d959 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:34.675140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ed11f812-d351-4713-ac75-9c227383d959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:34.739627 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 542/1100] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:35.020628 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480bf88-1a7f-4b5b-8dbc-8a564e54cf99 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:35.121069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480bf88-1a7f-4b5b-8dbc-8a564e54cf99 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:35.155529 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6634c0-5e64-490f-b9a6-16318f34cb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:35.156142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6634c0-5e64-490f-b9a6-16318f34cb95 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:35.156422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6634c0-5e64-490f-b9a6-16318f34cb95 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:35.156694 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6634c0-5e64-490f-b9a6-16318f34cb95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:35.167921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6634c0-5e64-490f-b9a6-16318f34cb95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:13:35.172525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-dc6634c0-5e64-490f-b9a6-16318f34cb95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:13:35.172525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:35.172525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:35.172525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:35.172525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:35.172525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:35.172525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:35.172525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:35.172525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:35.172525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:35.172525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:35.172525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:35.172525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:13:35.172525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:13:35.172525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:13:35.172525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:13:35.173595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:13:35.173595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:13:35.173595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:13:35.173595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:13:35.173595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:35.173595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:35.173595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:35.173595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:35.173595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:35.173595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:35.173595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:35.173595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:35.173595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:35.173595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:35.173595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:35.173595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:35.174479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:35.174479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:35.174479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:35.174479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:35.174479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:13:35.174479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:13:35.174479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:13:35.174479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:13:35.174479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:13:35.174479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:13:35.174479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:13:35.174479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:35.174479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 559/1101] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:13:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:35.179996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11f812-d351-4713-ac75-9c227383d959 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:35.275839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11f812-d351-4713-ac75-9c227383d959 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:35.286194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:35.309871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025bcf4-a9e2-48f2-80c1-225584e97e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:35.310502 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025bcf4-a9e2-48f2-80c1-225584e97e80 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:35.310788 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025bcf4-a9e2-48f2-80c1-225584e97e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:35.311064 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025bcf4-a9e2-48f2-80c1-225584e97e80 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:35.311727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025bcf4-a9e2-48f2-80c1-225584e97e80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:35.312032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025bcf4-a9e2-48f2-80c1-225584e97e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:35.313389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025bcf4-a9e2-48f2-80c1-225584e97e80 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:35.321820 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 543/1102] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:13:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:35.327564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6634c0-5e64-490f-b9a6-16318f34cb95 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:35.367550 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:35.426648 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6634c0-5e64-490f-b9a6-16318f34cb95 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:35.460092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166569d9-af7f-46e3-bbb0-31a47e5f42ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:35.460704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166569d9-af7f-46e3-bbb0-31a47e5f42ee None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:35.460984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166569d9-af7f-46e3-bbb0-31a47e5f42ee None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:35.461256 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166569d9-af7f-46e3-bbb0-31a47e5f42ee None admin] PATH_INFO: `/v3/users/93bd511515fe488bbd71aee2b5cf937c` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:35.462389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166569d9-af7f-46e3-bbb0-31a47e5f42ee None admin] RBAC: Authorizing `identity:get_user(user_id=93bd511515fe488bbd71aee2b5cf937c)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:35.463817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166569d9-af7f-46e3-bbb0-31a47e5f42ee None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:35.465357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 560/1103] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:13:35 2022] GET /identity/v3/users/93bd511515fe488bbd71aee2b5cf937c => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:35.471242 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025bcf4-a9e2-48f2-80c1-225584e97e80 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:35.576138 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025bcf4-a9e2-48f2-80c1-225584e97e80 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:35.608681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea02d89-e8f5-4cd7-8c0a-9df3975e7f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:35.609275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea02d89-e8f5-4cd7-8c0a-9df3975e7f49 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:35.609551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea02d89-e8f5-4cd7-8c0a-9df3975e7f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:35.609824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea02d89-e8f5-4cd7-8c0a-9df3975e7f49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:35.649156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:35.675437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea02d89-e8f5-4cd7-8c0a-9df3975e7f49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:35.676856 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea02d89-e8f5-4cd7-8c0a-9df3975e7f49 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:35.770937 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 544/1104] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:13:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:13:35.777745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166569d9-af7f-46e3-bbb0-31a47e5f42ee None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:35.874135 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166569d9-af7f-46e3-bbb0-31a47e5f42ee None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:35.880997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:35.907274 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3b6f9-3f45-4c0f-8129-1f580314d28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:35.908135 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3b6f9-3f45-4c0f-8129-1f580314d28f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:35.908410 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3b6f9-3f45-4c0f-8129-1f580314d28f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:35.908678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3b6f9-3f45-4c0f-8129-1f580314d28f None admin] PATH_INFO: `/v3/projects/79846aeecb934a49bc4e37b785853104` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:35.909769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3b6f9-3f45-4c0f-8129-1f580314d28f None admin] RBAC: Authorizing `identity:get_project(project_id=79846aeecb934a49bc4e37b785853104)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:35.911217 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3b6f9-3f45-4c0f-8129-1f580314d28f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:35.912967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 561/1105] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:13:35 2022] GET /identity/v3/projects/79846aeecb934a49bc4e37b785853104 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:35.919119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea02d89-e8f5-4cd7-8c0a-9df3975e7f49 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:35.992268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:36.027947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea02d89-e8f5-4cd7-8c0a-9df3975e7f49 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:36.061742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab9736-48a7-4892-b810-b9bc5c109b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:36.062358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab9736-48a7-4892-b810-b9bc5c109b32 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:36.062637 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab9736-48a7-4892-b810-b9bc5c109b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:36.062910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab9736-48a7-4892-b810-b9bc5c109b32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:36.063623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab9736-48a7-4892-b810-b9bc5c109b32 None admin] RBAC: Adding query filter params (role.id=8de0c87242d7426ea25a510b578c02aa, scope.project.id=79846aeecb934a49bc4e37b785853104, user.id=93bd511515fe488bbd71aee2b5cf937c) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:36.063928 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab9736-48a7-4892-b810-b9bc5c109b32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:36.065339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab9736-48a7-4892-b810-b9bc5c109b32 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:36.071048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 545/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:13:35 2022] GET /identity/v3/role_assignments?user.id=93bd511515fe488bbd71aee2b5cf937c&scope.project.id=79846aeecb934a49bc4e37b785853104&role.id=8de0c87242d7426ea25a510b578c02aa => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:37.968571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a960d6-ee3b-4b10-b3ab-0dd2d522c250 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:37.969168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a960d6-ee3b-4b10-b3ab-0dd2d522c250 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:37.969168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a960d6-ee3b-4b10-b3ab-0dd2d522c250 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:37.970456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 562/1107] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:37.975598 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6793f-4f71-4955-9139-68119efb942e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:37.976114 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6793f-4f71-4955-9139-68119efb942e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:37.976493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6793f-4f71-4955-9139-68119efb942e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:37.994764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-27f6793f-4f71-4955-9139-68119efb942e None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:37.995941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-27f6793f-4f71-4955-9139-68119efb942e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:38.060672 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 546/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:38.332150 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a960d6-ee3b-4b10-b3ab-0dd2d522c250 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:38.431669 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a960d6-ee3b-4b10-b3ab-0dd2d522c250 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:38.463694 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649da110-9b36-46e9-841b-815c37d0b853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:38.464303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649da110-9b36-46e9-841b-815c37d0b853 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:38.464577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649da110-9b36-46e9-841b-815c37d0b853 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:38.464847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649da110-9b36-46e9-841b-815c37d0b853 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:38.465930 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649da110-9b36-46e9-841b-815c37d0b853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:38.467370 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649da110-9b36-46e9-841b-815c37d0b853 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:38.468894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 563/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:38.474722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6793f-4f71-4955-9139-68119efb942e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:38.540856 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:38.575033 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6793f-4f71-4955-9139-68119efb942e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:38.609683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117783c4-263d-43ad-97bc-2b45d50134bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:38.610248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117783c4-263d-43ad-97bc-2b45d50134bf None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:38.610526 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117783c4-263d-43ad-97bc-2b45d50134bf None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:38.610796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117783c4-263d-43ad-97bc-2b45d50134bf None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:38.611435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117783c4-263d-43ad-97bc-2b45d50134bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:38.612835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117783c4-263d-43ad-97bc-2b45d50134bf None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:38.634274 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 547/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 16:13:38 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:13:40.557153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3dc29-cf22-47eb-a2d3-eda332af4d11 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:40.557690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3dc29-cf22-47eb-a2d3-eda332af4d11 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:40.557690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3dc29-cf22-47eb-a2d3-eda332af4d11 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:40.559098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 564/1111] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:40.564375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dd6b1-60bb-44df-9b28-95da7d74c685 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:40.564793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dd6b1-60bb-44df-9b28-95da7d74c685 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:40.564925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dd6b1-60bb-44df-9b28-95da7d74c685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:40.583043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-020dd6b1-60bb-44df-9b28-95da7d74c685 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:40.584225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-020dd6b1-60bb-44df-9b28-95da7d74c685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:40.650123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 548/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:40.924126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3dc29-cf22-47eb-a2d3-eda332af4d11 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:40.968491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:41.025083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3dc29-cf22-47eb-a2d3-eda332af4d11 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:41.058772 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8b7de-5fda-46ba-82af-da75b4a47fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:41.059385 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8b7de-5fda-46ba-82af-da75b4a47fac None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:41.059667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8b7de-5fda-46ba-82af-da75b4a47fac None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:41.059941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8b7de-5fda-46ba-82af-da75b4a47fac None admin] PATH_INFO: `/v3/roles/41d658f3417e4e48b117d57120991ad8` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:41.061317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8b7de-5fda-46ba-82af-da75b4a47fac None admin] RBAC: Authorizing `identity:get_role(role_id=41d658f3417e4e48b117d57120991ad8)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:41.062716 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8b7de-5fda-46ba-82af-da75b4a47fac None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:41.064012 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 565/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:13:40 2022] GET /identity/v3/roles/41d658f3417e4e48b117d57120991ad8 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:41.070818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dd6b1-60bb-44df-9b28-95da7d74c685 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:41.121706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:41.171024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020dd6b1-60bb-44df-9b28-95da7d74c685 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:41.204869 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda7ff5-c7b4-41f4-ab07-f84763962771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:41.205495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda7ff5-c7b4-41f4-ab07-f84763962771 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:41.205777 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda7ff5-c7b4-41f4-ab07-f84763962771 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:41.206051 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda7ff5-c7b4-41f4-ab07-f84763962771 None admin] PATH_INFO: `/v3/users/5f313ad64b2346799d92eb3d9acd19d8` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:41.219803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda7ff5-c7b4-41f4-ab07-f84763962771 None admin] RBAC: Authorizing `identity:get_user(user_id=5f313ad64b2346799d92eb3d9acd19d8)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:41.221236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda7ff5-c7b4-41f4-ab07-f84763962771 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:41.222870 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 549/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:13:41 2022] GET /identity/v3/users/5f313ad64b2346799d92eb3d9acd19d8 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:41.229329 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8b7de-5fda-46ba-82af-da75b4a47fac None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:41.331849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8b7de-5fda-46ba-82af-da75b4a47fac None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:41.342830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:41.365989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33877e6-1a63-4d59-8ab3-f6f4d87cdcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:41.366871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33877e6-1a63-4d59-8ab3-f6f4d87cdcfc None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:41.367160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33877e6-1a63-4d59-8ab3-f6f4d87cdcfc None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:41.367433 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33877e6-1a63-4d59-8ab3-f6f4d87cdcfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:41.432630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33877e6-1a63-4d59-8ab3-f6f4d87cdcfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:41.433995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33877e6-1a63-4d59-8ab3-f6f4d87cdcfc None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:41.531581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 566/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:13:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:13:41.538616 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda7ff5-c7b4-41f4-ab07-f84763962771 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:41.635143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda7ff5-c7b4-41f4-ab07-f84763962771 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:41.646018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:41.669413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c4323-63b1-4cd6-90ad-d071464bd5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:41.670025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c4323-63b1-4cd6-90ad-d071464bd5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:41.670336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c4323-63b1-4cd6-90ad-d071464bd5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:41.670607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c4323-63b1-4cd6-90ad-d071464bd5c1 None admin] PATH_INFO: `/v3/projects/79846aeecb934a49bc4e37b785853104` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:41.671698 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c4323-63b1-4cd6-90ad-d071464bd5c1 None admin] RBAC: Authorizing `identity:get_project(project_id=79846aeecb934a49bc4e37b785853104)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:41.673094 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c4323-63b1-4cd6-90ad-d071464bd5c1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:41.674720 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 550/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:13:41 2022] GET /identity/v3/projects/79846aeecb934a49bc4e37b785853104 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:41.681729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33877e6-1a63-4d59-8ab3-f6f4d87cdcfc None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:41.693159 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:41.778821 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33877e6-1a63-4d59-8ab3-f6f4d87cdcfc None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:41.811787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da0071-18b1-45bb-b0ba-eb6a98b7528d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:41.812379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da0071-18b1-45bb-b0ba-eb6a98b7528d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:41.812659 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da0071-18b1-45bb-b0ba-eb6a98b7528d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:41.812933 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da0071-18b1-45bb-b0ba-eb6a98b7528d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:41.813649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da0071-18b1-45bb-b0ba-eb6a98b7528d None admin] RBAC: Adding query filter params (role.id=41d658f3417e4e48b117d57120991ad8, scope.project.id=79846aeecb934a49bc4e37b785853104, user.id=5f313ad64b2346799d92eb3d9acd19d8) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:41.813959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da0071-18b1-45bb-b0ba-eb6a98b7528d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:41.815417 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da0071-18b1-45bb-b0ba-eb6a98b7528d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:41.820802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 567/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:13:41 2022] GET /identity/v3/role_assignments?user.id=5f313ad64b2346799d92eb3d9acd19d8&scope.project.id=79846aeecb934a49bc4e37b785853104&role.id=41d658f3417e4e48b117d57120991ad8 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:43.704065 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f43614-68bc-41a4-845e-712b39816c52 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:43.704590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f43614-68bc-41a4-845e-712b39816c52 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:43.704701 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f43614-68bc-41a4-845e-712b39816c52 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:43.706009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 551/1118] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:43.711965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d1ba4-50de-415c-b1a0-0cee6f56f4bf None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:43.712373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d1ba4-50de-415c-b1a0-0cee6f56f4bf None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:43.712512 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d1ba4-50de-415c-b1a0-0cee6f56f4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:43.730652 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-a01d1ba4-50de-415c-b1a0-0cee6f56f4bf None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:43.731829 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a01d1ba4-50de-415c-b1a0-0cee6f56f4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:43.798983 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 568/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:44.079889 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f43614-68bc-41a4-845e-712b39816c52 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:44.188966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f43614-68bc-41a4-845e-712b39816c52 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:44.223219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5b3b5-6f49-4a8e-b937-4568a57dce1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:44.224044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5b3b5-6f49-4a8e-b937-4568a57dce1e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:44.224421 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5b3b5-6f49-4a8e-b937-4568a57dce1e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:44.224916 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5b3b5-6f49-4a8e-b937-4568a57dce1e None admin] PATH_INFO: `/v3/roles/41d658f3417e4e48b117d57120991ad8` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:44.228017 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5b3b5-6f49-4a8e-b937-4568a57dce1e None admin] RBAC: Authorizing `identity:get_role(role_id=41d658f3417e4e48b117d57120991ad8)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:44.229577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5b3b5-6f49-4a8e-b937-4568a57dce1e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:44.231329 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 552/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:13:44 2022] GET /identity/v3/roles/41d658f3417e4e48b117d57120991ad8 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:44.237152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d1ba4-50de-415c-b1a0-0cee6f56f4bf None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:44.240225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:44.352841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d1ba4-50de-415c-b1a0-0cee6f56f4bf None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:44.395743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff969f7-9853-458b-8660-a0bfaae7d31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:44.396386 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff969f7-9853-458b-8660-a0bfaae7d31f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:44.396664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff969f7-9853-458b-8660-a0bfaae7d31f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:44.396937 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff969f7-9853-458b-8660-a0bfaae7d31f None admin] PATH_INFO: `/v3/users/5f313ad64b2346799d92eb3d9acd19d8` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:44.398148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff969f7-9853-458b-8660-a0bfaae7d31f None admin] RBAC: Authorizing `identity:get_user(user_id=5f313ad64b2346799d92eb3d9acd19d8)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:44.399593 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff969f7-9853-458b-8660-a0bfaae7d31f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:44.401190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 569/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:13:44 2022] GET /identity/v3/users/5f313ad64b2346799d92eb3d9acd19d8 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:44.407047 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5b3b5-6f49-4a8e-b937-4568a57dce1e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:44.474885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:44.536925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5b3b5-6f49-4a8e-b937-4568a57dce1e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:44.580767 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdfdd46-9103-4326-b46c-53c9bce4360f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:44.581402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfdd46-9103-4326-b46c-53c9bce4360f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:44.581684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfdd46-9103-4326-b46c-53c9bce4360f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:44.581959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdfdd46-9103-4326-b46c-53c9bce4360f None admin] PATH_INFO: `/v3/projects/79846aeecb934a49bc4e37b785853104` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:44.583118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdfdd46-9103-4326-b46c-53c9bce4360f None admin] RBAC: Authorizing `identity:get_project(project_id=79846aeecb934a49bc4e37b785853104)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:44.585201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdfdd46-9103-4326-b46c-53c9bce4360f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:44.587619 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 553/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:13:44 2022] GET /identity/v3/projects/79846aeecb934a49bc4e37b785853104 => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:44.593772 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff969f7-9853-458b-8660-a0bfaae7d31f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:44.664734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:44.698911 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff969f7-9853-458b-8660-a0bfaae7d31f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:44.740098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c28cd9-7c5c-4b8c-b6c7-9364c23a0c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:44.740850 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c28cd9-7c5c-4b8c-b6c7-9364c23a0c1b None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:44.741092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c28cd9-7c5c-4b8c-b6c7-9364c23a0c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:44.741491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c28cd9-7c5c-4b8c-b6c7-9364c23a0c1b None admin] PATH_INFO: `/v3/projects/79846aeecb934a49bc4e37b785853104/users/5f313ad64b2346799d92eb3d9acd19d8/roles/41d658f3417e4e48b117d57120991ad8` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:44.743852 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c28cd9-7c5c-4b8c-b6c7-9364c23a0c1b None admin] RBAC: Authorizing `identity:create_grant(project_id=79846aeecb934a49bc4e37b785853104, user_id=5f313ad64b2346799d92eb3d9acd19d8, role_id=41d658f3417e4e48b117d57120991ad8)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:44.746046 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c28cd9-7c5c-4b8c-b6c7-9364c23a0c1b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:44.759333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 570/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:13:44 2022] PUT /identity/v3/projects/79846aeecb934a49bc4e37b785853104/users/5f313ad64b2346799d92eb3d9acd19d8/roles/41d658f3417e4e48b117d57120991ad8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:13:46.649548 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae66a7e-af25-4c71-994f-fddbd91255c5 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:46.650173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae66a7e-af25-4c71-994f-fddbd91255c5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:46.650173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae66a7e-af25-4c71-994f-fddbd91255c5 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:46.651519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 554/1124] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:46.657083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0323c97-351f-4be8-aaba-cf8b0ff6afc8 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:46.657771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0323c97-351f-4be8-aaba-cf8b0ff6afc8 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:46.657895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0323c97-351f-4be8-aaba-cf8b0ff6afc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:46.676026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f0323c97-351f-4be8-aaba-cf8b0ff6afc8 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:46.677228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f0323c97-351f-4be8-aaba-cf8b0ff6afc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:46.743176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 571/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:47.012570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae66a7e-af25-4c71-994f-fddbd91255c5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:47.111820 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae66a7e-af25-4c71-994f-fddbd91255c5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:47.125329 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:47.144870 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24c075-41d0-4caf-881b-8b8964132d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:47.145490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c075-41d0-4caf-881b-8b8964132d95 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:47.145769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c075-41d0-4caf-881b-8b8964132d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:47.146042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c075-41d0-4caf-881b-8b8964132d95 None admin] PATH_INFO: `/v3/roles/41d658f3417e4e48b117d57120991ad8` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:47.148178 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24c075-41d0-4caf-881b-8b8964132d95 None admin] RBAC: Authorizing `identity:get_role(role_id=41d658f3417e4e48b117d57120991ad8)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:47.149527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24c075-41d0-4caf-881b-8b8964132d95 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:47.150863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 555/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:13:47 2022] GET /identity/v3/roles/41d658f3417e4e48b117d57120991ad8 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:47.156607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0323c97-351f-4be8-aaba-cf8b0ff6afc8 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:47.217680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:47.256604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0323c97-351f-4be8-aaba-cf8b0ff6afc8 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:47.290625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba423651-bac4-45e3-b5d1-414ed33a7b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:47.291177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba423651-bac4-45e3-b5d1-414ed33a7b46 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:47.291457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba423651-bac4-45e3-b5d1-414ed33a7b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:47.291729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba423651-bac4-45e3-b5d1-414ed33a7b46 None admin] PATH_INFO: `/v3/users/5f313ad64b2346799d92eb3d9acd19d8` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:47.292836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba423651-bac4-45e3-b5d1-414ed33a7b46 None admin] RBAC: Authorizing `identity:get_user(user_id=5f313ad64b2346799d92eb3d9acd19d8)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:47.294288 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba423651-bac4-45e3-b5d1-414ed33a7b46 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:47.295861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 572/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:13:47 2022] GET /identity/v3/users/5f313ad64b2346799d92eb3d9acd19d8 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:47.301668 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24c075-41d0-4caf-881b-8b8964132d95 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:47.398787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24c075-41d0-4caf-881b-8b8964132d95 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:47.431359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ef9c6-7959-4628-8320-1d5fd0c6a2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:47.431951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ef9c6-7959-4628-8320-1d5fd0c6a2eb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:47.432233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ef9c6-7959-4628-8320-1d5fd0c6a2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:47.432509 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ef9c6-7959-4628-8320-1d5fd0c6a2eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:47.479515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:47.497302 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ef9c6-7959-4628-8320-1d5fd0c6a2eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:47.498766 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ef9c6-7959-4628-8320-1d5fd0c6a2eb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:47.594820 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 556/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:13:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:13:47.600971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba423651-bac4-45e3-b5d1-414ed33a7b46 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:47.699555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba423651-bac4-45e3-b5d1-414ed33a7b46 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:47.728337 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:47.734456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf7411-300d-49a5-b132-8abd5f74e71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:47.735073 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf7411-300d-49a5-b132-8abd5f74e71c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:47.735355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf7411-300d-49a5-b132-8abd5f74e71c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:47.735629 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf7411-300d-49a5-b132-8abd5f74e71c None admin] PATH_INFO: `/v3/projects/79846aeecb934a49bc4e37b785853104` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:47.736741 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf7411-300d-49a5-b132-8abd5f74e71c None admin] RBAC: Authorizing `identity:get_project(project_id=79846aeecb934a49bc4e37b785853104)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:47.738273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf7411-300d-49a5-b132-8abd5f74e71c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:47.739886 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 573/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:13:47 2022] GET /identity/v3/projects/79846aeecb934a49bc4e37b785853104 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:47.746015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ef9c6-7959-4628-8320-1d5fd0c6a2eb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:47.824054 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:47.842373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ef9c6-7959-4628-8320-1d5fd0c6a2eb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:47.874867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b8046-5e7c-4831-b1c5-ae53d4c14b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:47.875404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b8046-5e7c-4831-b1c5-ae53d4c14b90 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:47.875684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b8046-5e7c-4831-b1c5-ae53d4c14b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:47.875957 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b8046-5e7c-4831-b1c5-ae53d4c14b90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:47.876667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b8046-5e7c-4831-b1c5-ae53d4c14b90 None admin] RBAC: Adding query filter params (role.id=41d658f3417e4e48b117d57120991ad8, scope.project.id=79846aeecb934a49bc4e37b785853104, user.id=5f313ad64b2346799d92eb3d9acd19d8) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:47.876973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b8046-5e7c-4831-b1c5-ae53d4c14b90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:47.878403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b8046-5e7c-4831-b1c5-ae53d4c14b90 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:47.884115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 557/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:13:47 2022] GET /identity/v3/role_assignments?user.id=5f313ad64b2346799d92eb3d9acd19d8&scope.project.id=79846aeecb934a49bc4e37b785853104&role.id=41d658f3417e4e48b117d57120991ad8 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:49.829569 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9d42-9f0f-4c19-8be8-2ceabdf2d185 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:49.830214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9d42-9f0f-4c19-8be8-2ceabdf2d185 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:49.830214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9d42-9f0f-4c19-8be8-2ceabdf2d185 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:49.831466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 574/1131] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:49.837363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7072f56-fa6c-4d75-b403-d69a00120889 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:49.837764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7072f56-fa6c-4d75-b403-d69a00120889 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:49.837919 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7072f56-fa6c-4d75-b403-d69a00120889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:49.856310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c7072f56-fa6c-4d75-b403-d69a00120889 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:49.857602 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c7072f56-fa6c-4d75-b403-d69a00120889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:49.933154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 558/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:50.201057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f9d42-9f0f-4c19-8be8-2ceabdf2d185 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:50.313939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f9d42-9f0f-4c19-8be8-2ceabdf2d185 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:50.348700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac24a43-d033-4110-afdb-1f2b71af67de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:50.349317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac24a43-d033-4110-afdb-1f2b71af67de None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:50.349597 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac24a43-d033-4110-afdb-1f2b71af67de None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:50.349871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac24a43-d033-4110-afdb-1f2b71af67de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:50.351403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac24a43-d033-4110-afdb-1f2b71af67de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:50.352961 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac24a43-d033-4110-afdb-1f2b71af67de None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:50.354552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 575/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:50.360427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7072f56-fa6c-4d75-b403-d69a00120889 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:50.433183 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:50.455340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7072f56-fa6c-4d75-b403-d69a00120889 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:50.487551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa169bd-9452-4453-91ba-53a8e79b2ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:50.488141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa169bd-9452-4453-91ba-53a8e79b2ee0 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:50.488416 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa169bd-9452-4453-91ba-53a8e79b2ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:50.488685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa169bd-9452-4453-91ba-53a8e79b2ee0 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:50.489314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa169bd-9452-4453-91ba-53a8e79b2ee0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:50.490770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa169bd-9452-4453-91ba-53a8e79b2ee0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:50.516729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 559/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 16:13:50 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:13:52.442717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ac596-b708-4325-9db8-ad128e91fdeb None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:52.443223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ac596-b708-4325-9db8-ad128e91fdeb None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:52.443223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ac596-b708-4325-9db8-ad128e91fdeb None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:52.444515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 576/1135] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:52.450703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23041113-28e8-487c-be26-6abf24fbe418 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:52.451093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23041113-28e8-487c-be26-6abf24fbe418 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:52.451266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23041113-28e8-487c-be26-6abf24fbe418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:52.469065 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-23041113-28e8-487c-be26-6abf24fbe418 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:52.470275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-23041113-28e8-487c-be26-6abf24fbe418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:52.536525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 560/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:52.811168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ac596-b708-4325-9db8-ad128e91fdeb None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:52.876668 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:52.912306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ac596-b708-4325-9db8-ad128e91fdeb None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:52.946324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdada347-37a7-462c-9bbd-80a12ffc03ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:52.946931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdada347-37a7-462c-9bbd-80a12ffc03ac None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:52.947213 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdada347-37a7-462c-9bbd-80a12ffc03ac None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:52.947486 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdada347-37a7-462c-9bbd-80a12ffc03ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:52.948592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdada347-37a7-462c-9bbd-80a12ffc03ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:52.950012 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdada347-37a7-462c-9bbd-80a12ffc03ac None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:52.951589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 577/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:13:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:52.957248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23041113-28e8-487c-be26-6abf24fbe418 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:53.012851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:53.054653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23041113-28e8-487c-be26-6abf24fbe418 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:53.087702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec3ca3-f57c-4748-8f00-c21662ed0700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:53.088245 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec3ca3-f57c-4748-8f00-c21662ed0700 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:53.088527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec3ca3-f57c-4748-8f00-c21662ed0700 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:53.088801 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec3ca3-f57c-4748-8f00-c21662ed0700 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:53.089456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec3ca3-f57c-4748-8f00-c21662ed0700 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:53.090895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec3ca3-f57c-4748-8f00-c21662ed0700 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:53.111309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 561/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 16:13:52 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:13:55.030585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397171a2-5d35-4ae8-ac45-3ff737f4b066 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:55.031156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397171a2-5d35-4ae8-ac45-3ff737f4b066 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:55.031156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397171a2-5d35-4ae8-ac45-3ff737f4b066 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:55.032737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 578/1139] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:55.038625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8157dbc-d590-40a9-9c72-da99a1f03c3d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:55.039069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8157dbc-d590-40a9-9c72-da99a1f03c3d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:55.039166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8157dbc-d590-40a9-9c72-da99a1f03c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:55.057643 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b8157dbc-d590-40a9-9c72-da99a1f03c3d None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:55.058861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b8157dbc-d590-40a9-9c72-da99a1f03c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:55.123280 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 562/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:13:55.393403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397171a2-5d35-4ae8-ac45-3ff737f4b066 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:55.493074 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397171a2-5d35-4ae8-ac45-3ff737f4b066 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:55.525899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b84b24-62f9-49a4-bfdb-eae0676fdec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:55.526541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b84b24-62f9-49a4-bfdb-eae0676fdec3 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:55.526856 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b84b24-62f9-49a4-bfdb-eae0676fdec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:55.527212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b84b24-62f9-49a4-bfdb-eae0676fdec3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:55.529291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:55.538894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b84b24-62f9-49a4-bfdb-eae0676fdec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:13:55.543459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-70b84b24-62f9-49a4-bfdb-eae0676fdec3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:13:55.543459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:55.543459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:55.543459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:55.543459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:55.543459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:55.543459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:55.543459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:55.543459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:55.543459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:55.543459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:55.543459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:55.543459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:13:55.543459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:13:55.543459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:13:55.543459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:13:55.544617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:13:55.544617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:13:55.544617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:13:55.544617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:13:55.544617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:55.544617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:55.544617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:55.544617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:55.544617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:55.544617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:55.544617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:55.544617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:55.544617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:55.544617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:55.544617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:55.544617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:55.545897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:55.545897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:55.545897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:55.545897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:55.545897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:13:55.545897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:13:55.545897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:13:55.545897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:13:55.545897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:13:55.545897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:13:55.545897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:13:55.545897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:55.545897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 579/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:13:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:55.550529 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8157dbc-d590-40a9-9c72-da99a1f03c3d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:55.595326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:55.648897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8157dbc-d590-40a9-9c72-da99a1f03c3d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:55.680779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaeaf8-fd47-41d4-a719-fd5d3ead6259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:55.681375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaeaf8-fd47-41d4-a719-fd5d3ead6259 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:55.681655 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaeaf8-fd47-41d4-a719-fd5d3ead6259 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:55.681926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaeaf8-fd47-41d4-a719-fd5d3ead6259 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:55.682611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaeaf8-fd47-41d4-a719-fd5d3ead6259 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:55.682914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaeaf8-fd47-41d4-a719-fd5d3ead6259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:55.684266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaeaf8-fd47-41d4-a719-fd5d3ead6259 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:55.691910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 563/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:13:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:55.698135 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b84b24-62f9-49a4-bfdb-eae0676fdec3 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:55.796761 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b84b24-62f9-49a4-bfdb-eae0676fdec3 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:55.829283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b09ef8-bc27-4920-a102-e57ef651daef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:55.829891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b09ef8-bc27-4920-a102-e57ef651daef None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:55.830200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b09ef8-bc27-4920-a102-e57ef651daef None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:55.830471 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b09ef8-bc27-4920-a102-e57ef651daef None admin] PATH_INFO: `/v3/users/9de2fd1f88b94ad2a8eb80d17d0346f4` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:55.843455 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b09ef8-bc27-4920-a102-e57ef651daef None admin] RBAC: Authorizing `identity:get_user(user_id=9de2fd1f88b94ad2a8eb80d17d0346f4)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:55.844882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b09ef8-bc27-4920-a102-e57ef651daef None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:55.846477 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 580/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:13:55 2022] GET /identity/v3/users/9de2fd1f88b94ad2a8eb80d17d0346f4 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:55.852915 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaeaf8-fd47-41d4-a719-fd5d3ead6259 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:55.950704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaeaf8-fd47-41d4-a719-fd5d3ead6259 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:55.957161 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:55.983677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a27263-9ca9-4116-93ff-735b9ec341fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:55.984270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a27263-9ca9-4116-93ff-735b9ec341fc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:55.984545 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a27263-9ca9-4116-93ff-735b9ec341fc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:55.984813 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a27263-9ca9-4116-93ff-735b9ec341fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:56.048652 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a27263-9ca9-4116-93ff-735b9ec341fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:56.050098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a27263-9ca9-4116-93ff-735b9ec341fc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:56.141709 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 564/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:13:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 16:13:56.148092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b09ef8-bc27-4920-a102-e57ef651daef None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:56.201497 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:56.246352 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b09ef8-bc27-4920-a102-e57ef651daef None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:56.280685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10301a44-4227-4a62-a5df-57952605cd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:56.281301 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10301a44-4227-4a62-a5df-57952605cd9a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:56.281637 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10301a44-4227-4a62-a5df-57952605cd9a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:56.281910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10301a44-4227-4a62-a5df-57952605cd9a None admin] PATH_INFO: `/v3/projects/cc755abecfcd4b5cbe3dfac18928bf33` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:56.283352 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10301a44-4227-4a62-a5df-57952605cd9a None admin] RBAC: Authorizing `identity:get_project(project_id=cc755abecfcd4b5cbe3dfac18928bf33)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:56.284772 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10301a44-4227-4a62-a5df-57952605cd9a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:56.286481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 581/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:13:56 2022] GET /identity/v3/projects/cc755abecfcd4b5cbe3dfac18928bf33 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:56.293228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a27263-9ca9-4116-93ff-735b9ec341fc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:56.301209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:56.394001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a27263-9ca9-4116-93ff-735b9ec341fc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:56.426580 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec1f37-dbee-4253-b8f7-81cdd0ac8438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:56.427172 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec1f37-dbee-4253-b8f7-81cdd0ac8438 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:56.427448 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec1f37-dbee-4253-b8f7-81cdd0ac8438 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:56.427718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec1f37-dbee-4253-b8f7-81cdd0ac8438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:56.428454 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec1f37-dbee-4253-b8f7-81cdd0ac8438 None admin] RBAC: Adding query filter params (role.id=8de0c87242d7426ea25a510b578c02aa, scope.project.id=cc755abecfcd4b5cbe3dfac18928bf33, user.id=9de2fd1f88b94ad2a8eb80d17d0346f4) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:56.428759 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec1f37-dbee-4253-b8f7-81cdd0ac8438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:56.430188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec1f37-dbee-4253-b8f7-81cdd0ac8438 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:56.435286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 565/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:13:56 2022] GET /identity/v3/role_assignments?user.id=9de2fd1f88b94ad2a8eb80d17d0346f4&scope.project.id=cc755abecfcd4b5cbe3dfac18928bf33&role.id=8de0c87242d7426ea25a510b578c02aa => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:58.323119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821f628-9d22-45c2-816f-77352a98f3f8 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:58.323640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821f628-9d22-45c2-816f-77352a98f3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:58.323762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821f628-9d22-45c2-816f-77352a98f3f8 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:58.324998 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 582/1147] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:13:58.330300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b4db4-fb50-43da-b066-6cc934246335 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:58.330698 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b4db4-fb50-43da-b066-6cc934246335 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:58.330860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b4db4-fb50-43da-b066-6cc934246335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:58.350502 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-cb0b4db4-fb50-43da-b066-6cc934246335 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:13:58.352310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cb0b4db4-fb50-43da-b066-6cc934246335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:13:58.412081 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:58.417601 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 566/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:13:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:13:58.682926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821f628-9d22-45c2-816f-77352a98f3f8 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:58.783626 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821f628-9d22-45c2-816f-77352a98f3f8 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:58.804238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:58.819055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5b11e-8cd2-4cfe-b4bc-8ebc2f6da8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:58.819665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5b11e-8cd2-4cfe-b4bc-8ebc2f6da8ab None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:58.819938 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5b11e-8cd2-4cfe-b4bc-8ebc2f6da8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:58.820208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5b11e-8cd2-4cfe-b4bc-8ebc2f6da8ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:58.829952 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5b11e-8cd2-4cfe-b4bc-8ebc2f6da8ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:13:58.835146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-56d5b11e-8cd2-4cfe-b4bc-8ebc2f6da8ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:13:58.835146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:13:58.835146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:13:58.835146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:13:58.835146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:13:58.835146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:13:58.835146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:13:58.835146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:13:58.835146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:13:58.835146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:13:58.835146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:13:58.835146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:13:58.835146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:13:58.835146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:13:58.835146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:13:58.835146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:13:58.838182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:13:58.838182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:13:58.838182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:13:58.838182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:13:58.838182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:13:58.838182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:13:58.838182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:13:58.838182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:13:58.838182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:13:58.838182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:13:58.838182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:13:58.838182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:13:58.838182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:13:58.838182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:13:58.838182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:13:58.838182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:13:58.839334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:13:58.839334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:13:58.839334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:13:58.839334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:13:58.839334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:13:58.839334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:13:58.839334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:13:58.839334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:13:58.839334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:13:58.839334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:13:58.839334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:13:58.839334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:13:58.839334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 583/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:13:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:13:58.842308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b4db4-fb50-43da-b066-6cc934246335 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:58.937652 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b4db4-fb50-43da-b066-6cc934246335 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:58.971054 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880773bb-bbe7-4906-8498-7320354c4797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:58.971647 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880773bb-bbe7-4906-8498-7320354c4797 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:58.971925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880773bb-bbe7-4906-8498-7320354c4797 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:58.972197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880773bb-bbe7-4906-8498-7320354c4797 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:58.972857 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880773bb-bbe7-4906-8498-7320354c4797 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:13:58.973156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880773bb-bbe7-4906-8498-7320354c4797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:58.974542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880773bb-bbe7-4906-8498-7320354c4797 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:58.982415 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 567/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:13:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:58.988302 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5b11e-8cd2-4cfe-b4bc-8ebc2f6da8ab None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:59.085792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5b11e-8cd2-4cfe-b4bc-8ebc2f6da8ab None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:59.118004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2bcdc-3e9f-48d2-b3e2-e0264a18340e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:59.118648 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2bcdc-3e9f-48d2-b3e2-e0264a18340e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:59.118928 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2bcdc-3e9f-48d2-b3e2-e0264a18340e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:59.119200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2bcdc-3e9f-48d2-b3e2-e0264a18340e None admin] PATH_INFO: `/v3/users/9de2fd1f88b94ad2a8eb80d17d0346f4` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:59.120312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2bcdc-3e9f-48d2-b3e2-e0264a18340e None admin] RBAC: Authorizing `identity:get_user(user_id=9de2fd1f88b94ad2a8eb80d17d0346f4)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:59.121731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2bcdc-3e9f-48d2-b3e2-e0264a18340e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:59.123308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 584/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:13:58 2022] GET /identity/v3/users/9de2fd1f88b94ad2a8eb80d17d0346f4 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:59.128994 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880773bb-bbe7-4906-8498-7320354c4797 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:59.189080 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:59.227808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880773bb-bbe7-4906-8498-7320354c4797 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:59.260292 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594372fe-263f-420f-aada-ea719798168d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:59.260892 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594372fe-263f-420f-aada-ea719798168d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:59.261168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594372fe-263f-420f-aada-ea719798168d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:59.261438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594372fe-263f-420f-aada-ea719798168d None admin] PATH_INFO: `/v3/projects/cc755abecfcd4b5cbe3dfac18928bf33` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:59.262570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594372fe-263f-420f-aada-ea719798168d None admin] RBAC: Authorizing `identity:get_project(project_id=cc755abecfcd4b5cbe3dfac18928bf33)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:59.263982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594372fe-263f-420f-aada-ea719798168d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:59.265574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 568/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:13:59 2022] GET /identity/v3/projects/cc755abecfcd4b5cbe3dfac18928bf33 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:13:59.271679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2bcdc-3e9f-48d2-b3e2-e0264a18340e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:13:59.320363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:13:59.371443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2bcdc-3e9f-48d2-b3e2-e0264a18340e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:13:59.403344 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ead67-f72e-4871-9dab-fa6d2e910f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:13:59.403987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ead67-f72e-4871-9dab-fa6d2e910f5d None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:13:59.404266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ead67-f72e-4871-9dab-fa6d2e910f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:13:59.404545 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ead67-f72e-4871-9dab-fa6d2e910f5d None admin] PATH_INFO: `/v3/projects/cc755abecfcd4b5cbe3dfac18928bf33/users/9de2fd1f88b94ad2a8eb80d17d0346f4/roles/8de0c87242d7426ea25a510b578c02aa` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:13:59.406433 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ead67-f72e-4871-9dab-fa6d2e910f5d None admin] RBAC: Authorizing `identity:create_grant(project_id=cc755abecfcd4b5cbe3dfac18928bf33, user_id=9de2fd1f88b94ad2a8eb80d17d0346f4, role_id=8de0c87242d7426ea25a510b578c02aa)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:13:59.408107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ead67-f72e-4871-9dab-fa6d2e910f5d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:13:59.421626 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 585/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:13:59 2022] PUT /identity/v3/projects/cc755abecfcd4b5cbe3dfac18928bf33/users/9de2fd1f88b94ad2a8eb80d17d0346f4/roles/8de0c87242d7426ea25a510b578c02aa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:14:01.327965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad374733-14dc-4734-b3d6-f139041f01ae None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:01.328481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad374733-14dc-4734-b3d6-f139041f01ae None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:01.328577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad374733-14dc-4734-b3d6-f139041f01ae None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:01.329852 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 569/1154] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:14:01.336294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03cd21-e307-41f7-9fe5-d45cf0e0413d None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:01.336742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03cd21-e307-41f7-9fe5-d45cf0e0413d None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:01.336835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03cd21-e307-41f7-9fe5-d45cf0e0413d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:01.355424 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-de03cd21-e307-41f7-9fe5-d45cf0e0413d None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:14:01.356602 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-de03cd21-e307-41f7-9fe5-d45cf0e0413d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:14:01.423293 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 586/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:14:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:14:01.693886 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad374733-14dc-4734-b3d6-f139041f01ae None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:01.792465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad374733-14dc-4734-b3d6-f139041f01ae None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:01.819478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:01.825406 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11520db-2a35-4989-ba8b-4df90a7c6b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:01.826034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11520db-2a35-4989-ba8b-4df90a7c6b32 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:01.826342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11520db-2a35-4989-ba8b-4df90a7c6b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:01.826620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11520db-2a35-4989-ba8b-4df90a7c6b32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:01.838247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11520db-2a35-4989-ba8b-4df90a7c6b32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:14:01.842818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-c11520db-2a35-4989-ba8b-4df90a7c6b32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:14:01.842818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:14:01.842818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:14:01.842818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:14:01.842818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:14:01.842818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:14:01.842818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:14:01.842818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:14:01.842818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:14:01.842818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:14:01.842818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:14:01.842818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:14:01.842818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:14:01.842818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:14:01.842818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:14:01.842818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:14:01.843898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:14:01.843898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:14:01.843898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:14:01.843898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:14:01.843898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:14:01.843898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:14:01.843898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:14:01.843898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:14:01.843898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:14:01.843898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:14:01.843898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:14:01.843898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:14:01.843898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:14:01.843898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:14:01.843898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:14:01.843898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:14:01.844776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:14:01.844776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:14:01.844776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:14:01.844776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:14:01.844776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:14:01.844776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:14:01.844776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:14:01.844776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:14:01.844776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:14:01.844776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:14:01.844776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:14:01.844776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:14:01.844776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 570/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:14:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:14:01.850199 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03cd21-e307-41f7-9fe5-d45cf0e0413d None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:01.888739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:01.949759 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03cd21-e307-41f7-9fe5-d45cf0e0413d None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:01.982775 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c8d82-c01e-4975-8248-9d65321f9d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:01.983370 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c8d82-c01e-4975-8248-9d65321f9d4e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:01.983652 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c8d82-c01e-4975-8248-9d65321f9d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:01.983929 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c8d82-c01e-4975-8248-9d65321f9d4e None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:01.984600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c8d82-c01e-4975-8248-9d65321f9d4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:14:01.984905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c8d82-c01e-4975-8248-9d65321f9d4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:01.986295 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56c8d82-c01e-4975-8248-9d65321f9d4e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:01.995253 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 587/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:14:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:14:02.001003 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11520db-2a35-4989-ba8b-4df90a7c6b32 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:02.098379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11520db-2a35-4989-ba8b-4df90a7c6b32 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:02.131430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf9c4c-5253-4d71-8493-158602157f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:02.132038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf9c4c-5253-4d71-8493-158602157f60 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:02.132320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf9c4c-5253-4d71-8493-158602157f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:02.132593 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf9c4c-5253-4d71-8493-158602157f60 None admin] PATH_INFO: `/v3/users/9de2fd1f88b94ad2a8eb80d17d0346f4` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:02.133714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf9c4c-5253-4d71-8493-158602157f60 None admin] RBAC: Authorizing `identity:get_user(user_id=9de2fd1f88b94ad2a8eb80d17d0346f4)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:02.135172 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf9c4c-5253-4d71-8493-158602157f60 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:02.136736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 571/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:14:02 2022] GET /identity/v3/users/9de2fd1f88b94ad2a8eb80d17d0346f4 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:14:02.142785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c8d82-c01e-4975-8248-9d65321f9d4e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:02.238897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:02.242626 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c8d82-c01e-4975-8248-9d65321f9d4e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:02.275600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab202264-7dc3-41a6-8995-7f855e069b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:02.276209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab202264-7dc3-41a6-8995-7f855e069b71 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:02.276467 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab202264-7dc3-41a6-8995-7f855e069b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:02.276819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab202264-7dc3-41a6-8995-7f855e069b71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:02.352854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab202264-7dc3-41a6-8995-7f855e069b71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:02.354340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab202264-7dc3-41a6-8995-7f855e069b71 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:02.449007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:02.452865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 588/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:14:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 16:14:02.458741 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf9c4c-5253-4d71-8493-158602157f60 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:02.515958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:02.557656 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf9c4c-5253-4d71-8493-158602157f60 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:02.590411 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc42f9-e917-4f58-a34a-4369b76c10d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:02.591034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc42f9-e917-4f58-a34a-4369b76c10d9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:02.591317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc42f9-e917-4f58-a34a-4369b76c10d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:02.591596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc42f9-e917-4f58-a34a-4369b76c10d9 None admin] PATH_INFO: `/v3/projects/cc755abecfcd4b5cbe3dfac18928bf33` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:02.592718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc42f9-e917-4f58-a34a-4369b76c10d9 None admin] RBAC: Authorizing `identity:get_project(project_id=cc755abecfcd4b5cbe3dfac18928bf33)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:02.594166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc42f9-e917-4f58-a34a-4369b76c10d9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:02.595787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 572/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:14:02 2022] GET /identity/v3/projects/cc755abecfcd4b5cbe3dfac18928bf33 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:14:02.601912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab202264-7dc3-41a6-8995-7f855e069b71 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:02.699757 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab202264-7dc3-41a6-8995-7f855e069b71 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:02.732606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88915764-d658-4032-bd19-aa24516dda29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:02.733200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88915764-d658-4032-bd19-aa24516dda29 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:02.733480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88915764-d658-4032-bd19-aa24516dda29 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:02.733752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88915764-d658-4032-bd19-aa24516dda29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:02.734507 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88915764-d658-4032-bd19-aa24516dda29 None admin] RBAC: Adding query filter params (role.id=8de0c87242d7426ea25a510b578c02aa, scope.project.id=cc755abecfcd4b5cbe3dfac18928bf33, user.id=9de2fd1f88b94ad2a8eb80d17d0346f4) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:14:02.734817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88915764-d658-4032-bd19-aa24516dda29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:02.736239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88915764-d658-4032-bd19-aa24516dda29 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:02.742400 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 589/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:14:02 2022] GET /identity/v3/role_assignments?user.id=9de2fd1f88b94ad2a8eb80d17d0346f4&scope.project.id=cc755abecfcd4b5cbe3dfac18928bf33&role.id=8de0c87242d7426ea25a510b578c02aa => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:14:04.649710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22881a7-5806-45ea-b791-4680cc62bce8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:04.650282 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22881a7-5806-45ea-b791-4680cc62bce8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:04.650282 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22881a7-5806-45ea-b791-4680cc62bce8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:04.651632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 573/1162] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:14:04.656748 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4c85e-fa80-4964-b2c1-4d9d908143ee None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:04.657375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4c85e-fa80-4964-b2c1-4d9d908143ee None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:04.657552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4c85e-fa80-4964-b2c1-4d9d908143ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:04.675747 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-55c4c85e-fa80-4964-b2c1-4d9d908143ee None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:14:04.676929 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-55c4c85e-fa80-4964-b2c1-4d9d908143ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:14:04.733420 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:04.743205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 590/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:14:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:14:05.012795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22881a7-5806-45ea-b791-4680cc62bce8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:05.112513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22881a7-5806-45ea-b791-4680cc62bce8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:05.137673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:05.146614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844da9ce-823e-4ada-9140-b3f26026ed16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:05.147213 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844da9ce-823e-4ada-9140-b3f26026ed16 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:05.147494 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844da9ce-823e-4ada-9140-b3f26026ed16 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:05.147770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844da9ce-823e-4ada-9140-b3f26026ed16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:05.214564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844da9ce-823e-4ada-9140-b3f26026ed16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:05.215994 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844da9ce-823e-4ada-9140-b3f26026ed16 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:05.313965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 574/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:14:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:14:05.320360 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4c85e-fa80-4964-b2c1-4d9d908143ee None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:05.416294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4c85e-fa80-4964-b2c1-4d9d908143ee None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:05.449973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370385a-c0a4-4aa1-b924-81031ad743dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:05.450622 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370385a-c0a4-4aa1-b924-81031ad743dd None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:05.450902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370385a-c0a4-4aa1-b924-81031ad743dd None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:05.451175 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370385a-c0a4-4aa1-b924-81031ad743dd None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:05.457660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370385a-c0a4-4aa1-b924-81031ad743dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:05.459286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370385a-c0a4-4aa1-b924-81031ad743dd None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:05.470235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-b370385a-c0a4-4aa1-b924-81031ad743dd None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 23 16:14:05.470235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:14:05.470235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 23 16:14:05.470235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 23 16:14:05.470235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:14:05.470235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:14:05.470235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:14:05.470235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:14:05.470235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 23 16:14:05.470235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:14:05.470235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:14:05.470235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:14:05.470235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:14:05.470235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:14:05.470235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:14:05.470235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:14:05.470235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:14:05.471401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:14:05.471401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:14:05.471401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:14:05.471401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:14:05.471401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:14:05.471401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:14:05.471401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:14:05.471401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:14:05.471401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:14:05.471401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:14:05.471401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:14:05.471401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:14:05.471401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:14:05.471401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:14:05.471401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:14:05.471401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:14:05.472270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:14:05.472270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:14:05.472270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:14:05.472270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:14:05.472270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:14:05.472270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:14:05.472270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:14:05.472270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:14:05.472270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:14:05.472270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:14:05.472270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 23 16:14:05.472270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:14:05.472270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 23 16:14:05.472270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:14:05.472270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 591/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 23 16:14:05 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:14:05.477783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844da9ce-823e-4ada-9140-b3f26026ed16 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:05.503657 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:05.573242 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844da9ce-823e-4ada-9140-b3f26026ed16 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:05.607585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c3719-7eaf-4c53-93ad-516efb7e72b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:05.608188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c3719-7eaf-4c53-93ad-516efb7e72b0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:05.608465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c3719-7eaf-4c53-93ad-516efb7e72b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:05.608734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c3719-7eaf-4c53-93ad-516efb7e72b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:05.609370 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c3719-7eaf-4c53-93ad-516efb7e72b0 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:14:05.609670 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c3719-7eaf-4c53-93ad-516efb7e72b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:05.613055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c3719-7eaf-4c53-93ad-516efb7e72b0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:05.619055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 575/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 23 16:14:05 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:14:07.530752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b9225-40f0-4e9a-85d2-6a1e6e3bf0cf None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:07.531350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b9225-40f0-4e9a-85d2-6a1e6e3bf0cf None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:07.531350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b9225-40f0-4e9a-85d2-6a1e6e3bf0cf None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:07.532849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 592/1167] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:14:07.538829 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896161c-b72e-4459-8e45-f6f7c9a977c5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:07.539243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896161c-b72e-4459-8e45-f6f7c9a977c5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:07.539390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896161c-b72e-4459-8e45-f6f7c9a977c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:07.557576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c896161c-b72e-4459-8e45-f6f7c9a977c5 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:14:07.558783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c896161c-b72e-4459-8e45-f6f7c9a977c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:14:07.623416 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 576/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:14:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:14:07.904553 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b9225-40f0-4e9a-85d2-6a1e6e3bf0cf None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:07.961014 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:08.006492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b9225-40f0-4e9a-85d2-6a1e6e3bf0cf None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:08.038799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b7395-2daa-4fea-9bf5-1021ecc83c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:08.039384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b7395-2daa-4fea-9bf5-1021ecc83c7c None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:08.039662 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b7395-2daa-4fea-9bf5-1021ecc83c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:08.039934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b7395-2daa-4fea-9bf5-1021ecc83c7c None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:08.040584 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b7395-2daa-4fea-9bf5-1021ecc83c7c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:08.041941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b7395-2daa-4fea-9bf5-1021ecc83c7c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:08.057322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 593/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Tue Aug 23 16:14:07 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:14:10.007584 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15df5e6-2eda-4194-be93-6e6872d266f3 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:10.008154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15df5e6-2eda-4194-be93-6e6872d266f3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:10.008154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15df5e6-2eda-4194-be93-6e6872d266f3 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:10.009467 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 577/1170] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:14:10.014795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662630b-5234-4d3d-85fd-4d29bfbf27d3 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:10.015194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662630b-5234-4d3d-85fd-4d29bfbf27d3 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:10.015339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662630b-5234-4d3d-85fd-4d29bfbf27d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:10.033733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-2662630b-5234-4d3d-85fd-4d29bfbf27d3 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:14:10.034939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-2662630b-5234-4d3d-85fd-4d29bfbf27d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:14:10.100537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 594/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:14:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:14:10.378585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15df5e6-2eda-4194-be93-6e6872d266f3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:10.400489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:10.480169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15df5e6-2eda-4194-be93-6e6872d266f3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:10.516437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64950334-a5f4-4b89-a948-58412ff81d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:10.517060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64950334-a5f4-4b89-a948-58412ff81d1c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:10.517342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64950334-a5f4-4b89-a948-58412ff81d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:10.517616 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64950334-a5f4-4b89-a948-58412ff81d1c None admin] PATH_INFO: `/v3/domains/849487dd64b8462ab5c3fc9bbe33a624` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:10.527935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64950334-a5f4-4b89-a948-58412ff81d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=849487dd64b8462ab5c3fc9bbe33a624)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:10.529374 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64950334-a5f4-4b89-a948-58412ff81d1c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:10.531016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 578/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Tue Aug 23 16:14:10 2022] GET /identity/v3/domains/849487dd64b8462ab5c3fc9bbe33a624 => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:14:10.537940 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662630b-5234-4d3d-85fd-4d29bfbf27d3 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:10.582283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:10.635248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662630b-5234-4d3d-85fd-4d29bfbf27d3 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:10.667962 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770941e-f32d-477e-9d42-e79339a9476c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:10.668552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770941e-f32d-477e-9d42-e79339a9476c None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:10.668828 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770941e-f32d-477e-9d42-e79339a9476c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:10.669096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770941e-f32d-477e-9d42-e79339a9476c None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:10.669736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770941e-f32d-477e-9d42-e79339a9476c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:10.671188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770941e-f32d-477e-9d42-e79339a9476c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:10.696776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 595/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 16:14:10 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:14:12.658051 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e123342-a9fa-4c4b-aab4-5bdb719d8cf3 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:12.658637 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e123342-a9fa-4c4b-aab4-5bdb719d8cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:12.658637 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e123342-a9fa-4c4b-aab4-5bdb719d8cf3 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:12.659990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 579/1174] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:14:12.665123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5b4ff-12b6-463a-a86f-59d67e928f48 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:12.665518 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5b4ff-12b6-463a-a86f-59d67e928f48 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:12.665677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5b4ff-12b6-463a-a86f-59d67e928f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:12.683810 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-98c5b4ff-12b6-463a-a86f-59d67e928f48 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:14:12.684988 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-98c5b4ff-12b6-463a-a86f-59d67e928f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:14:12.750820 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 596/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:14:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:14:13.031974 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e123342-a9fa-4c4b-aab4-5bdb719d8cf3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:13.111834 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:13.131671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e123342-a9fa-4c4b-aab4-5bdb719d8cf3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:13.163844 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b3f52-fa6f-45ec-b836-ecebc8c1d452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:13.164465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3f52-fa6f-45ec-b836-ecebc8c1d452 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:13.164742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3f52-fa6f-45ec-b836-ecebc8c1d452 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:13.165009 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3f52-fa6f-45ec-b836-ecebc8c1d452 None admin] PATH_INFO: `/v3/domains/849487dd64b8462ab5c3fc9bbe33a624` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:13.166129 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b3f52-fa6f-45ec-b836-ecebc8c1d452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=849487dd64b8462ab5c3fc9bbe33a624)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:13.167534 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b3f52-fa6f-45ec-b836-ecebc8c1d452 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:13.169083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 580/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Tue Aug 23 16:14:13 2022] GET /identity/v3/domains/849487dd64b8462ab5c3fc9bbe33a624 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:14:13.174785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5b4ff-12b6-463a-a86f-59d67e928f48 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:13.201589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:13.273835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5b4ff-12b6-463a-a86f-59d67e928f48 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:13.306343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a4931-3c6d-45da-a1aa-b25256b3e90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:13.306954 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a4931-3c6d-45da-a1aa-b25256b3e90d None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:13.307211 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a4931-3c6d-45da-a1aa-b25256b3e90d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:13.307482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a4931-3c6d-45da-a1aa-b25256b3e90d None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:13.308118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a4931-3c6d-45da-a1aa-b25256b3e90d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:13.309525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a4931-3c6d-45da-a1aa-b25256b3e90d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:13.329735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 597/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 16:14:13 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:14:15.274076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f47ffa-28d9-4cca-8be1-ee04dc5dc6e7 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:15.274570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f47ffa-28d9-4cca-8be1-ee04dc5dc6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:15.274690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f47ffa-28d9-4cca-8be1-ee04dc5dc6e7 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:15.275987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 581/1178] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:14:15.281280 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529607bd-e9c8-4940-bc94-d95248da7cf7 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:15.281969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529607bd-e9c8-4940-bc94-d95248da7cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:15.282113 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529607bd-e9c8-4940-bc94-d95248da7cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:15.300954 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-529607bd-e9c8-4940-bc94-d95248da7cf7 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:14:15.303041 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-529607bd-e9c8-4940-bc94-d95248da7cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:14:15.368047 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 598/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:14:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:14:15.632719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f47ffa-28d9-4cca-8be1-ee04dc5dc6e7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:15.731753 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f47ffa-28d9-4cca-8be1-ee04dc5dc6e7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:15.764125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6808b-5571-44c6-84d7-27deed4ffd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:15.764739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6808b-5571-44c6-84d7-27deed4ffd5b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:15.765017 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6808b-5571-44c6-84d7-27deed4ffd5b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:15.765285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6808b-5571-44c6-84d7-27deed4ffd5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:15.775856 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6808b-5571-44c6-84d7-27deed4ffd5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:14:15.780399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-97c6808b-5571-44c6-84d7-27deed4ffd5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:14:15.780399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:14:15.780399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:14:15.780399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:14:15.780399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:14:15.780399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:14:15.780399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:14:15.780399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:14:15.780399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:14:15.780399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:14:15.780399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:14:15.780399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:14:15.780399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:14:15.780399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:14:15.780399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:14:15.780399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:14:15.781562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:14:15.781562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:14:15.781562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:14:15.781562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:14:15.781562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:14:15.781562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:14:15.781562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:14:15.781562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:14:15.781562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:14:15.781562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:14:15.781562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:14:15.781562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:14:15.781562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:14:15.781562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:14:15.781562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:14:15.781562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:14:15.783068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:14:15.783068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:14:15.783068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:14:15.783068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:14:15.783068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:14:15.783068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:14:15.783068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:14:15.783068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:14:15.783068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:14:15.783068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:14:15.783068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:14:15.783068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:14:15.783068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 582/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:14:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:14:15.788445 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529607bd-e9c8-4940-bc94-d95248da7cf7 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:15.802249 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:15.886087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529607bd-e9c8-4940-bc94-d95248da7cf7 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:15.919564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69081799-1a48-4cf5-ac27-95d6100bd76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:15.920160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69081799-1a48-4cf5-ac27-95d6100bd76e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:15.920440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69081799-1a48-4cf5-ac27-95d6100bd76e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:15.920712 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69081799-1a48-4cf5-ac27-95d6100bd76e None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:15.921371 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69081799-1a48-4cf5-ac27-95d6100bd76e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:14:15.921674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69081799-1a48-4cf5-ac27-95d6100bd76e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:15.923074 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69081799-1a48-4cf5-ac27-95d6100bd76e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:15.930971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 599/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:14:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:14:15.936854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6808b-5571-44c6-84d7-27deed4ffd5b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:15.948369 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:16.035512 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6808b-5571-44c6-84d7-27deed4ffd5b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:16.067984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d27a0-bb31-413b-a45b-1a829b688447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:16.068773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d27a0-bb31-413b-a45b-1a829b688447 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:16.069060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d27a0-bb31-413b-a45b-1a829b688447 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:16.069340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d27a0-bb31-413b-a45b-1a829b688447 None admin] PATH_INFO: `/v3/users/bc5d27076f3f4b12bb8a27c829a2cb3d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:16.081818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d27a0-bb31-413b-a45b-1a829b688447 None admin] RBAC: Authorizing `identity:get_user(user_id=bc5d27076f3f4b12bb8a27c829a2cb3d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:16.083487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d27a0-bb31-413b-a45b-1a829b688447 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:16.085083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 583/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:14:15 2022] GET /identity/v3/users/bc5d27076f3f4b12bb8a27c829a2cb3d => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:14:16.090969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69081799-1a48-4cf5-ac27-95d6100bd76e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:16.165430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:16.190849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69081799-1a48-4cf5-ac27-95d6100bd76e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:16.223046 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd09e74-6d70-46d0-9ea3-19a8f05dbdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:16.224166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd09e74-6d70-46d0-9ea3-19a8f05dbdfc None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:16.224451 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd09e74-6d70-46d0-9ea3-19a8f05dbdfc None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:16.224719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd09e74-6d70-46d0-9ea3-19a8f05dbdfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:16.289482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd09e74-6d70-46d0-9ea3-19a8f05dbdfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:16.290945 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd09e74-6d70-46d0-9ea3-19a8f05dbdfc None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:16.361291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:16.387071 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 600/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:14:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:14:16.392996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d27a0-bb31-413b-a45b-1a829b688447 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:16.456773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:16.492644 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d27a0-bb31-413b-a45b-1a829b688447 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:16.525160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f576d-200e-4dd0-b2cc-1e9f1e3665e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:16.525777 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f576d-200e-4dd0-b2cc-1e9f1e3665e9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:16.526057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f576d-200e-4dd0-b2cc-1e9f1e3665e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:16.526357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f576d-200e-4dd0-b2cc-1e9f1e3665e9 None admin] PATH_INFO: `/v3/projects/667cfdccec8545caa1cd8c9b889467ff` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:16.527467 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f576d-200e-4dd0-b2cc-1e9f1e3665e9 None admin] RBAC: Authorizing `identity:get_project(project_id=667cfdccec8545caa1cd8c9b889467ff)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:16.528881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f576d-200e-4dd0-b2cc-1e9f1e3665e9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:16.530533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 584/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:14:16 2022] GET /identity/v3/projects/667cfdccec8545caa1cd8c9b889467ff => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:14:16.537667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd09e74-6d70-46d0-9ea3-19a8f05dbdfc None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:16.634715 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd09e74-6d70-46d0-9ea3-19a8f05dbdfc None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:16.668682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6654ab-e7ec-421c-a91b-a668828ea746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:16.669269 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6654ab-e7ec-421c-a91b-a668828ea746 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:16.669546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6654ab-e7ec-421c-a91b-a668828ea746 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:16.669814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6654ab-e7ec-421c-a91b-a668828ea746 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:16.670552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6654ab-e7ec-421c-a91b-a668828ea746 None admin] RBAC: Adding query filter params (role.id=8de0c87242d7426ea25a510b578c02aa, scope.project.id=667cfdccec8545caa1cd8c9b889467ff, user.id=bc5d27076f3f4b12bb8a27c829a2cb3d) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:14:16.670861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6654ab-e7ec-421c-a91b-a668828ea746 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:16.672267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6654ab-e7ec-421c-a91b-a668828ea746 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:16.678451 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 601/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:14:16 2022] GET /identity/v3/role_assignments?user.id=bc5d27076f3f4b12bb8a27c829a2cb3d&scope.project.id=667cfdccec8545caa1cd8c9b889467ff&role.id=8de0c87242d7426ea25a510b578c02aa => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:14:18.566542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd3ced-256e-476b-906f-41d9795e9032 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:18.567058 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd3ced-256e-476b-906f-41d9795e9032 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:18.567210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd3ced-256e-476b-906f-41d9795e9032 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:18.569411 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 585/1186] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:14:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:14:18.574738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6314416-954f-4927-b3eb-80e04168bad5 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:18.575186 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6314416-954f-4927-b3eb-80e04168bad5 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:18.575284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6314416-954f-4927-b3eb-80e04168bad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:18.593347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-c6314416-954f-4927-b3eb-80e04168bad5 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:14:18.594558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c6314416-954f-4927-b3eb-80e04168bad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:14:18.623892 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:18.661100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 602/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:14:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:14:18.929824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd3ced-256e-476b-906f-41d9795e9032 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:19.034048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd3ced-256e-476b-906f-41d9795e9032 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:19.066076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8de77e-b565-47af-8c6c-647d39493a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:19.066778 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de77e-b565-47af-8c6c-647d39493a51 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:19.067060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de77e-b565-47af-8c6c-647d39493a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:19.067903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8de77e-b565-47af-8c6c-647d39493a51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:19.069741 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:19.078823 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8de77e-b565-47af-8c6c-647d39493a51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:14:19.084076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-8d8de77e-b565-47af-8c6c-647d39493a51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:14:19.084076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:14:19.084076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:14:19.084076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:14:19.084076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:14:19.084076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:14:19.084076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:14:19.084076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:14:19.084076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:14:19.084076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:14:19.084076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:14:19.084076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:14:19.084076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:14:19.084076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:14:19.084076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:14:19.084076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:14:19.085222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:14:19.085222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:14:19.085222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:14:19.085222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:14:19.085222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:14:19.085222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:14:19.085222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:14:19.085222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:14:19.085222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:14:19.085222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:14:19.085222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:14:19.085222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:14:19.085222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:14:19.085222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:14:19.085222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:14:19.085222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:14:19.086270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:14:19.086270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:14:19.086270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:14:19.086270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:14:19.086270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:14:19.086270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:14:19.086270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:14:19.086270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:14:19.086270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:14:19.086270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:14:19.086270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:14:19.086270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:14:19.086270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 586/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:14:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:14:19.091191 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6314416-954f-4927-b3eb-80e04168bad5 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:19.187626 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6314416-954f-4927-b3eb-80e04168bad5 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:19.220292 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac4f49-76b4-478d-9502-3354f2abf06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:19.220881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac4f49-76b4-478d-9502-3354f2abf06a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:19.221156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac4f49-76b4-478d-9502-3354f2abf06a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:19.221428 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac4f49-76b4-478d-9502-3354f2abf06a None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:19.222099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac4f49-76b4-478d-9502-3354f2abf06a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:14:19.222405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac4f49-76b4-478d-9502-3354f2abf06a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:19.223791 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac4f49-76b4-478d-9502-3354f2abf06a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:19.231515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 603/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:14:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:14:19.237251 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8de77e-b565-47af-8c6c-647d39493a51 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:19.340220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8de77e-b565-47af-8c6c-647d39493a51 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:19.374299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2a53b-88f7-4e21-9bed-7730490051c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:19.374918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2a53b-88f7-4e21-9bed-7730490051c4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:19.375196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2a53b-88f7-4e21-9bed-7730490051c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:19.375466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2a53b-88f7-4e21-9bed-7730490051c4 None admin] PATH_INFO: `/v3/users/bc5d27076f3f4b12bb8a27c829a2cb3d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:19.376567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2a53b-88f7-4e21-9bed-7730490051c4 None admin] RBAC: Authorizing `identity:get_user(user_id=bc5d27076f3f4b12bb8a27c829a2cb3d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:19.378002 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2a53b-88f7-4e21-9bed-7730490051c4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:19.379591 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 587/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:14:19 2022] GET /identity/v3/users/bc5d27076f3f4b12bb8a27c829a2cb3d => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:14:19.385872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac4f49-76b4-478d-9502-3354f2abf06a None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:19.417190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:19.484451 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac4f49-76b4-478d-9502-3354f2abf06a None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:19.517428 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cba3b0-4589-44a1-8070-269dca26d384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:19.518039 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cba3b0-4589-44a1-8070-269dca26d384 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:19.518350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cba3b0-4589-44a1-8070-269dca26d384 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:19.518623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cba3b0-4589-44a1-8070-269dca26d384 None admin] PATH_INFO: `/v3/projects/667cfdccec8545caa1cd8c9b889467ff` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:19.519728 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cba3b0-4589-44a1-8070-269dca26d384 None admin] RBAC: Authorizing `identity:get_project(project_id=667cfdccec8545caa1cd8c9b889467ff)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:19.521262 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cba3b0-4589-44a1-8070-269dca26d384 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:19.522898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 604/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:14:19 2022] GET /identity/v3/projects/667cfdccec8545caa1cd8c9b889467ff => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:14:19.528773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2a53b-88f7-4e21-9bed-7730490051c4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:19.591316 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:19.627761 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2a53b-88f7-4e21-9bed-7730490051c4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:19.662359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ede66-eb99-432e-a594-273c59892fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:19.663355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ede66-eb99-432e-a594-273c59892fd1 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:19.663855 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ede66-eb99-432e-a594-273c59892fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:19.664335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ede66-eb99-432e-a594-273c59892fd1 None admin] PATH_INFO: `/v3/projects/667cfdccec8545caa1cd8c9b889467ff/users/bc5d27076f3f4b12bb8a27c829a2cb3d/roles/8de0c87242d7426ea25a510b578c02aa` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:19.666967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ede66-eb99-432e-a594-273c59892fd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=667cfdccec8545caa1cd8c9b889467ff, user_id=bc5d27076f3f4b12bb8a27c829a2cb3d, role_id=8de0c87242d7426ea25a510b578c02aa)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:19.668382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ede66-eb99-432e-a594-273c59892fd1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:19.681547 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 588/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:14:19 2022] PUT /identity/v3/projects/667cfdccec8545caa1cd8c9b889467ff/users/bc5d27076f3f4b12bb8a27c829a2cb3d/roles/8de0c87242d7426ea25a510b578c02aa => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:14:21.594440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a519f-0a2c-4850-9bcc-7d2d8955eb3e None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:21.594998 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a519f-0a2c-4850-9bcc-7d2d8955eb3e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:21.594998 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a519f-0a2c-4850-9bcc-7d2d8955eb3e None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:21.596325 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 605/1193] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:14:21.601557 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02edf0c-e45e-46db-b931-23ac2adefe7e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:21.601952 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02edf0c-e45e-46db-b931-23ac2adefe7e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:21.602139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02edf0c-e45e-46db-b931-23ac2adefe7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:21.620405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c02edf0c-e45e-46db-b931-23ac2adefe7e None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:14:21.621584 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c02edf0c-e45e-46db-b931-23ac2adefe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:14:21.685499 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 589/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:14:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:14:21.953513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a519f-0a2c-4850-9bcc-7d2d8955eb3e None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:22.054495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:22.059823 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a519f-0a2c-4850-9bcc-7d2d8955eb3e None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:22.092200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0f4d5-5016-441b-8541-08410010586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:22.092818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0f4d5-5016-441b-8541-08410010586d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:22.093099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0f4d5-5016-441b-8541-08410010586d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:22.093375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0f4d5-5016-441b-8541-08410010586d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:22.104217 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0f4d5-5016-441b-8541-08410010586d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:14:22.108912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-6bf0f4d5-5016-441b-8541-08410010586d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:14:22.108912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:14:22.108912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:14:22.108912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:14:22.108912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:14:22.108912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:14:22.108912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:14:22.108912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:14:22.108912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:14:22.108912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:14:22.108912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:14:22.108912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:14:22.108912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:14:22.108912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:14:22.108912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:14:22.108912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:14:22.110032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:14:22.110032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:14:22.110032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:14:22.110032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:14:22.110032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:14:22.110032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:14:22.110032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:14:22.110032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:14:22.110032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:14:22.110032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:14:22.110032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:14:22.110032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:14:22.110032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:14:22.110032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:14:22.110032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:14:22.110032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:14:22.111267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:14:22.111267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:14:22.111267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:14:22.111267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:14:22.111267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:14:22.111267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:14:22.111267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:14:22.111267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:14:22.111267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:14:22.111267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:14:22.111267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:14:22.111267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:14:22.111267 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 606/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:14:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:14:22.116673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02edf0c-e45e-46db-b931-23ac2adefe7e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:22.167726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:22.215491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02edf0c-e45e-46db-b931-23ac2adefe7e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:22.248826 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bfe3e-68d0-4e5f-b35b-3a997672cd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:22.249426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bfe3e-68d0-4e5f-b35b-3a997672cd70 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:22.249705 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bfe3e-68d0-4e5f-b35b-3a997672cd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:22.249980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bfe3e-68d0-4e5f-b35b-3a997672cd70 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:22.250674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4bfe3e-68d0-4e5f-b35b-3a997672cd70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:14:22.250977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4bfe3e-68d0-4e5f-b35b-3a997672cd70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:22.252332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4bfe3e-68d0-4e5f-b35b-3a997672cd70 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:22.260733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 590/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:14:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:14:22.266552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0f4d5-5016-441b-8541-08410010586d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:22.364946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0f4d5-5016-441b-8541-08410010586d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:22.398081 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec565f-eee4-489e-9bb4-f542179ccc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:22.398715 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec565f-eee4-489e-9bb4-f542179ccc08 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:22.398996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec565f-eee4-489e-9bb4-f542179ccc08 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:22.399270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec565f-eee4-489e-9bb4-f542179ccc08 None admin] PATH_INFO: `/v3/users/bc5d27076f3f4b12bb8a27c829a2cb3d` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:22.400379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec565f-eee4-489e-9bb4-f542179ccc08 None admin] RBAC: Authorizing `identity:get_user(user_id=bc5d27076f3f4b12bb8a27c829a2cb3d)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:22.401797 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec565f-eee4-489e-9bb4-f542179ccc08 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:22.403368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 607/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 16:14:22 2022] GET /identity/v3/users/bc5d27076f3f4b12bb8a27c829a2cb3d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:14:22.409536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bfe3e-68d0-4e5f-b35b-3a997672cd70 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:22.508076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bfe3e-68d0-4e5f-b35b-3a997672cd70 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:22.520796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:22.542771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc530d1d-55ee-46d8-ba1c-6982d5a4f66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:22.543372 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc530d1d-55ee-46d8-ba1c-6982d5a4f66f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:22.543652 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc530d1d-55ee-46d8-ba1c-6982d5a4f66f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:22.543924 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc530d1d-55ee-46d8-ba1c-6982d5a4f66f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:22.608543 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc530d1d-55ee-46d8-ba1c-6982d5a4f66f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:22.610003 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc530d1d-55ee-46d8-ba1c-6982d5a4f66f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:22.704201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 591/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:14:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:14:22.710737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec565f-eee4-489e-9bb4-f542179ccc08 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:22.738217 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:22.809876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec565f-eee4-489e-9bb4-f542179ccc08 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:22.843052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134f930-54c4-4fe9-88f0-b02d2a37f44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:22.843668 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134f930-54c4-4fe9-88f0-b02d2a37f44a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:22.843949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134f930-54c4-4fe9-88f0-b02d2a37f44a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:22.844222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134f930-54c4-4fe9-88f0-b02d2a37f44a None admin] PATH_INFO: `/v3/projects/667cfdccec8545caa1cd8c9b889467ff` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:22.845331 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134f930-54c4-4fe9-88f0-b02d2a37f44a None admin] RBAC: Authorizing `identity:get_project(project_id=667cfdccec8545caa1cd8c9b889467ff)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:22.846790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134f930-54c4-4fe9-88f0-b02d2a37f44a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:22.848562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 608/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 16:14:22 2022] GET /identity/v3/projects/667cfdccec8545caa1cd8c9b889467ff => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:14:22.854799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc530d1d-55ee-46d8-ba1c-6982d5a4f66f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:14:22.869258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:22.951959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc530d1d-55ee-46d8-ba1c-6982d5a4f66f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:14:22.984875 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d93b2f-d77f-407b-ab39-4f2a3269cb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:14:22.985468 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93b2f-d77f-407b-ab39-4f2a3269cb45 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:14:22.985748 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93b2f-d77f-407b-ab39-4f2a3269cb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:14:22.986019 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93b2f-d77f-407b-ab39-4f2a3269cb45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:14:22.986760 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d93b2f-d77f-407b-ab39-4f2a3269cb45 None admin] RBAC: Adding query filter params (role.id=8de0c87242d7426ea25a510b578c02aa, scope.project.id=667cfdccec8545caa1cd8c9b889467ff, user.id=bc5d27076f3f4b12bb8a27c829a2cb3d) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:14:22.987067 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d93b2f-d77f-407b-ab39-4f2a3269cb45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:14:22.988470 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d93b2f-d77f-407b-ab39-4f2a3269cb45 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:14:22.994805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 592/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:14:22 2022] GET /identity/v3/role_assignments?user.id=bc5d27076f3f4b12bb8a27c829a2cb3d&scope.project.id=667cfdccec8545caa1cd8c9b889467ff&role.id=8de0c87242d7426ea25a510b578c02aa => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:14:32.838979 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=53 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:14:32.992286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=61 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:18.835391 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ebe2f-c888-4d92-9e7e-32c198bc84f6 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:18.836095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ebe2f-c888-4d92-9e7e-32c198bc84f6 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:18.836095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ebe2f-c888-4d92-9e7e-32c198bc84f6 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:18.837289 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 609/1201] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:15:18.842741 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a9469-5e93-4dc1-9ecd-cc5d972d3e44 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:18.843214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a9469-5e93-4dc1-9ecd-cc5d972d3e44 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:18.843322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a9469-5e93-4dc1-9ecd-cc5d972d3e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:18.865752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-676a9469-5e93-4dc1-9ecd-cc5d972d3e44 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:18.867025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-676a9469-5e93-4dc1-9ecd-cc5d972d3e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:18.954536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 593/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:15:19.239997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ebe2f-c888-4d92-9e7e-32c198bc84f6 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:19.377594 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ebe2f-c888-4d92-9e7e-32c198bc84f6 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:19.423257 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98c12c-7b99-43d5-a07d-86482d156b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:19.427470 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98c12c-7b99-43d5-a07d-86482d156b26 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:19.427470 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98c12c-7b99-43d5-a07d-86482d156b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:19.427470 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98c12c-7b99-43d5-a07d-86482d156b26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:19.441819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98c12c-7b99-43d5-a07d-86482d156b26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:19.443605 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98c12c-7b99-43d5-a07d-86482d156b26 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:19.460517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-3b98c12c-7b99-43d5-a07d-86482d156b26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:19.460517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:19.460517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:19.460517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:19.460517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:19.460517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:19.460517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:19.460517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:19.460517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:19.460517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:19.460517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:19.460517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:19.460517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:15:19.460517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:15:19.460517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:15:19.460517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:15:19.461645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:19.461645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:19.461645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:19.461645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:19.461645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:19.461645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:19.461645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:19.461645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:19.461645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:19.461645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:19.461645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:19.461645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:19.461645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:19.461645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:19.461645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:19.461645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:19.461645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:15:19.462752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:15:19.462752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:19.462752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:15:19.462752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 610/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:19.468826 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a9469-5e93-4dc1-9ecd-cc5d972d3e44 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:19.607938 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a9469-5e93-4dc1-9ecd-cc5d972d3e44 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:19.646271 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:19.653169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf4a67-3e89-47ed-9fdf-ea5c496c1570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:19.653784 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf4a67-3e89-47ed-9fdf-ea5c496c1570 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:19.654091 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf4a67-3e89-47ed-9fdf-ea5c496c1570 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:19.654629 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf4a67-3e89-47ed-9fdf-ea5c496c1570 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:19.655752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf4a67-3e89-47ed-9fdf-ea5c496c1570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:19.655752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf4a67-3e89-47ed-9fdf-ea5c496c1570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:19.658387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf4a67-3e89-47ed-9fdf-ea5c496c1570 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:19.675917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 594/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:19.681963 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98c12c-7b99-43d5-a07d-86482d156b26 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:19.753615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:19.815329 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98c12c-7b99-43d5-a07d-86482d156b26 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:19.853165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3c7a4-d564-4e69-8de8-5522e066a5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:19.854677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3c7a4-d564-4e69-8de8-5522e066a5bb None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:19.855117 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3c7a4-d564-4e69-8de8-5522e066a5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:19.855559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3c7a4-d564-4e69-8de8-5522e066a5bb None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:19.856210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3c7a4-d564-4e69-8de8-5522e066a5bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:19.857632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3c7a4-d564-4e69-8de8-5522e066a5bb None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:19.882862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 611/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 16:15:19 2022] POST /identity/v3/users => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:15:22.045404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a384da3-aa87-4364-b6a7-9f733ec2113e None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:22.046014 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a384da3-aa87-4364-b6a7-9f733ec2113e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:22.046014 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a384da3-aa87-4364-b6a7-9f733ec2113e None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:22.049948 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 595/1206] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:22.053247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d452ea-75ba-45d6-80a4-e26088c63252 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:22.053723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d452ea-75ba-45d6-80a4-e26088c63252 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:22.053908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d452ea-75ba-45d6-80a4-e26088c63252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:22.074897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f8d452ea-75ba-45d6-80a4-e26088c63252 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:22.076250 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f8d452ea-75ba-45d6-80a4-e26088c63252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:22.154118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 612/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:15:22.450048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a384da3-aa87-4364-b6a7-9f733ec2113e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:22.566117 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a384da3-aa87-4364-b6a7-9f733ec2113e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:22.607798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c9686-9169-4413-a4d5-0b059bc544d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:22.608437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c9686-9169-4413-a4d5-0b059bc544d7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:22.608720 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c9686-9169-4413-a4d5-0b059bc544d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:22.608987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c9686-9169-4413-a4d5-0b059bc544d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:22.620668 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c9686-9169-4413-a4d5-0b059bc544d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:22.626264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-7e5c9686-9169-4413-a4d5-0b059bc544d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:15:22.626264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:22.626264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:22.626264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:22.626264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:22.626264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:22.626264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:22.626264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:22.626264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:22.626264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:22.626264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:22.626264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:22.626264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:22.626264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:22.626264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:22.626264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:22.627450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:22.627450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:22.627450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:22.627450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:22.627450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:22.627450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:22.627450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:22.627450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:22.627450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:22.627450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:22.627450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:22.627450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:22.627450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:22.627450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:22.627450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:22.627450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:22.628723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:22.628723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:22.628723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:22.628723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:22.628723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:22.628723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:22.628723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:22.628723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:22.628723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:22.628723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:22.628723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:15:22.628723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:22.628723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 596/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:15:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:22.637396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d452ea-75ba-45d6-80a4-e26088c63252 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:22.684775 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:22.754155 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d452ea-75ba-45d6-80a4-e26088c63252 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:22.805351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15db417-25ec-4e8f-b25e-05d3ba3a2a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:22.805977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15db417-25ec-4e8f-b25e-05d3ba3a2a61 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:22.806292 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15db417-25ec-4e8f-b25e-05d3ba3a2a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:22.806564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15db417-25ec-4e8f-b25e-05d3ba3a2a61 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:22.807268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15db417-25ec-4e8f-b25e-05d3ba3a2a61 None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:22.807550 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15db417-25ec-4e8f-b25e-05d3ba3a2a61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:22.808966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15db417-25ec-4e8f-b25e-05d3ba3a2a61 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:22.819442 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 613/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:15:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:22.825310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c9686-9169-4413-a4d5-0b059bc544d7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:22.888528 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:22.945192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c9686-9169-4413-a4d5-0b059bc544d7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:22.992326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bea394-8c9a-4b48-92cf-e252d27094f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:22.992968 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bea394-8c9a-4b48-92cf-e252d27094f0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:22.993252 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bea394-8c9a-4b48-92cf-e252d27094f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:22.993573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bea394-8c9a-4b48-92cf-e252d27094f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:23.007250 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bea394-8c9a-4b48-92cf-e252d27094f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:23.008670 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bea394-8c9a-4b48-92cf-e252d27094f0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:23.024306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-08bea394-8c9a-4b48-92cf-e252d27094f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:23.024306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:23.024306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:23.024306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:23.024306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:23.024306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:23.024306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:23.024306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:23.024306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:23.024306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:23.024306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:23.024306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:23.024306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:15:23.024306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:15:23.024306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:15:23.024306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:15:23.025419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:23.025419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:23.025419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:23.025419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:23.025419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:23.025419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:23.025419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:23.025419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:23.025419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:23.025419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:23.025419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:23.025419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:23.025419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:23.025419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:23.025419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:23.025419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:23.025419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:15:23.026385 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:15:23.026385 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:23.026385 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:23.026385 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 597/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:15:23.032824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15db417-25ec-4e8f-b25e-05d3ba3a2a61 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:23.144393 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:23.147593 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15db417-25ec-4e8f-b25e-05d3ba3a2a61 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:23.191551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7afb3e-0cba-45d8-a39d-2189dd5af9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:23.192210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7afb3e-0cba-45d8-a39d-2189dd5af9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:23.192491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7afb3e-0cba-45d8-a39d-2189dd5af9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:23.192813 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7afb3e-0cba-45d8-a39d-2189dd5af9a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:23.193520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7afb3e-0cba-45d8-a39d-2189dd5af9a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:23.193862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7afb3e-0cba-45d8-a39d-2189dd5af9a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:23.195471 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7afb3e-0cba-45d8-a39d-2189dd5af9a0 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:23.208771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 614/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:23.215104 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bea394-8c9a-4b48-92cf-e252d27094f0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:23.334927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bea394-8c9a-4b48-92cf-e252d27094f0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:23.337299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:23.377148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c863c-761d-48e4-922c-6157c95ec882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:23.377992 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c863c-761d-48e4-922c-6157c95ec882 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:23.378443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c863c-761d-48e4-922c-6157c95ec882 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:23.378710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c863c-761d-48e4-922c-6157c95ec882 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:23.387220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c863c-761d-48e4-922c-6157c95ec882 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:23.388661 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c863c-761d-48e4-922c-6157c95ec882 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:23.401152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-9c7c863c-761d-48e4-922c-6157c95ec882 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:15:23.401152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:23.401152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:23.401152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:23.401152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:23.401152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:23.401152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:23.401152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:23.401152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:23.401152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:23.401152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:23.401152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:23.401152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:15:23.401152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:15:23.401152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:15:23.401152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:15:23.402685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:23.402685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:23.402685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:15:23.402685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:15:23.402685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:15:23.402685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:15:23.402685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:23.402685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:23.402685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:23.402685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:23.402685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:23.402685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:23.402685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:23.402685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:23.402685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:23.402685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:23.402685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:23.402685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:23.403854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:23.403854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:23.403854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:15:23.403854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:15:23.403854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:15:23.403854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:15:23.403854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:15:23.403854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:15:23.403854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:15:23.403854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:23.403854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 598/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:23.409323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7afb3e-0cba-45d8-a39d-2189dd5af9a0 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:23.529429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7afb3e-0cba-45d8-a39d-2189dd5af9a0 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:23.579604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cb214-a4bf-4c1d-8935-d135541c395e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:23.580246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cb214-a4bf-4c1d-8935-d135541c395e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:23.580536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cb214-a4bf-4c1d-8935-d135541c395e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:23.580798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cb214-a4bf-4c1d-8935-d135541c395e None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:23.581790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305cb214-a4bf-4c1d-8935-d135541c395e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:23.581790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305cb214-a4bf-4c1d-8935-d135541c395e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:23.583301 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305cb214-a4bf-4c1d-8935-d135541c395e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:23.602790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 615/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 23 16:15:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:23.608491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c863c-761d-48e4-922c-6157c95ec882 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:23.727091 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c863c-761d-48e4-922c-6157c95ec882 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:23.771884 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b374694-8d67-45ca-8c31-909d2af9e36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:23.772627 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b374694-8d67-45ca-8c31-909d2af9e36a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:23.772935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b374694-8d67-45ca-8c31-909d2af9e36a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:23.773303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b374694-8d67-45ca-8c31-909d2af9e36a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:23.810264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:23.852602 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b374694-8d67-45ca-8c31-909d2af9e36a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:23.854401 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b374694-8d67-45ca-8c31-909d2af9e36a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:23.989635 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 599/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:15:23.996226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cb214-a4bf-4c1d-8935-d135541c395e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:24.018325 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:24.117741 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cb214-a4bf-4c1d-8935-d135541c395e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:24.162105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e22ef2-67e8-4ee9-9b5a-4b1e7e549442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:24.162729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e22ef2-67e8-4ee9-9b5a-4b1e7e549442 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:24.163827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e22ef2-67e8-4ee9-9b5a-4b1e7e549442 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:24.163827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e22ef2-67e8-4ee9-9b5a-4b1e7e549442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:24.176154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e22ef2-67e8-4ee9-9b5a-4b1e7e549442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:24.178234 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e22ef2-67e8-4ee9-9b5a-4b1e7e549442 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:24.195084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-50e22ef2-67e8-4ee9-9b5a-4b1e7e549442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:24.195084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:24.195084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:24.195084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:24.195084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:24.195084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:24.195084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:24.195084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:24.195084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:24.195084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:24.195084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:24.195084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:24.195084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:15:24.195084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:15:24.195084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:15:24.195084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:15:24.196244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:24.196244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:24.196244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:24.196244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:24.196244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:24.196244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:24.196244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:24.196244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:24.196244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:24.196244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:24.196244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:24.196244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:24.196244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:24.196244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:24.196244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:24.196244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:24.196244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:15:24.197381 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:15:24.197381 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:24.197381 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:15:24.198558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 616/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:24.205515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b374694-8d67-45ca-8c31-909d2af9e36a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:24.274357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:24.316623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b374694-8d67-45ca-8c31-909d2af9e36a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:24.356510 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387c390-3849-481b-b007-ac017b2d39c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:24.357168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387c390-3849-481b-b007-ac017b2d39c1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:24.357450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387c390-3849-481b-b007-ac017b2d39c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:24.357727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387c390-3849-481b-b007-ac017b2d39c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:24.358414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387c390-3849-481b-b007-ac017b2d39c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:24.358714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387c390-3849-481b-b007-ac017b2d39c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:24.360676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387c390-3849-481b-b007-ac017b2d39c1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:24.374176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 600/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:24.380343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e22ef2-67e8-4ee9-9b5a-4b1e7e549442 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:24.462936 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:24.500216 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e22ef2-67e8-4ee9-9b5a-4b1e7e549442 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:24.543289 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b461e24-c0e5-4dad-95b2-cd6efc1871c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:24.544216 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b461e24-c0e5-4dad-95b2-cd6efc1871c2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:24.544554 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b461e24-c0e5-4dad-95b2-cd6efc1871c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:24.544943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b461e24-c0e5-4dad-95b2-cd6efc1871c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:24.553172 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b461e24-c0e5-4dad-95b2-cd6efc1871c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:24.556059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b461e24-c0e5-4dad-95b2-cd6efc1871c2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:24.572111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-2b461e24-c0e5-4dad-95b2-cd6efc1871c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:15:24.572111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:24.572111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:24.572111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:24.572111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:24.572111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:24.572111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:24.572111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:24.572111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:24.572111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:24.572111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:24.572111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:24.572111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:15:24.572111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:15:24.572111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:15:24.573093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:15:24.573093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:24.573093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:24.573093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:24.573093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:24.573093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:24.573093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:24.573093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:24.573093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:24.573093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:24.573093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:24.573093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:24.573093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:24.573093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:24.573093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:24.573093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:24.573093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:24.574083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:15:24.574083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:15:24.574083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:15:24.574083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:15:24.574083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:15:24.574083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:15:24.574083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:15:24.574083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:15:24.574999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 617/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:15:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:24.583690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387c390-3849-481b-b007-ac017b2d39c1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:24.698000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387c390-3849-481b-b007-ac017b2d39c1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:24.723985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:24.738130 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4174d-5e16-4ac0-a1f5-c8305267dec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:24.738891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4174d-5e16-4ac0-a1f5-c8305267dec4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:24.739240 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4174d-5e16-4ac0-a1f5-c8305267dec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:24.739577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4174d-5e16-4ac0-a1f5-c8305267dec4 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:24.740368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4174d-5e16-4ac0-a1f5-c8305267dec4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:24.740740 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4174d-5e16-4ac0-a1f5-c8305267dec4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:24.742281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4174d-5e16-4ac0-a1f5-c8305267dec4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:24.760003 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 601/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:15:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:24.762118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b461e24-c0e5-4dad-95b2-cd6efc1871c2 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:24.903189 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b461e24-c0e5-4dad-95b2-cd6efc1871c2 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:24.937048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:24.944246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b9877-7ec7-4366-957e-b55167b3e883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:24.944938 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b9877-7ec7-4366-957e-b55167b3e883 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:24.945323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b9877-7ec7-4366-957e-b55167b3e883 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:24.945583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b9877-7ec7-4366-957e-b55167b3e883 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:24.946391 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b9877-7ec7-4366-957e-b55167b3e883 None admin] RBAC: Adding query filter params (role.id=bbf63b75406649a3b653308ecb75062d, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=9cd1309c315e49eea6af4691d14c3e90) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:24.946774 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b9877-7ec7-4366-957e-b55167b3e883 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:24.948392 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b9877-7ec7-4366-957e-b55167b3e883 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:24.955955 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 618/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:15:24 2022] GET /identity/v3/role_assignments?user.id=9cd1309c315e49eea6af4691d14c3e90&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=bbf63b75406649a3b653308ecb75062d => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:26.886939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f37315-7ab9-41c7-b200-07ec533621d2 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:26.887525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f37315-7ab9-41c7-b200-07ec533621d2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:26.887525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f37315-7ab9-41c7-b200-07ec533621d2 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:26.888835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 602/1220] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:26.895613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb580fb-3c2d-45d4-8c45-49a617bfc89b None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:26.896105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb580fb-3c2d-45d4-8c45-49a617bfc89b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:26.896366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb580fb-3c2d-45d4-8c45-49a617bfc89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:26.919370 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-cbb580fb-3c2d-45d4-8c45-49a617bfc89b None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:26.920676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-cbb580fb-3c2d-45d4-8c45-49a617bfc89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:26.996331 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 619/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:15:27.285158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f37315-7ab9-41c7-b200-07ec533621d2 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:27.398659 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f37315-7ab9-41c7-b200-07ec533621d2 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:27.434052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90fb3b-c31c-445c-a257-95a630f9b33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:27.434660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90fb3b-c31c-445c-a257-95a630f9b33f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:27.434941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90fb3b-c31c-445c-a257-95a630f9b33f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:27.435242 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90fb3b-c31c-445c-a257-95a630f9b33f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:27.445301 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90fb3b-c31c-445c-a257-95a630f9b33f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:27.449894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-ee90fb3b-c31c-445c-a257-95a630f9b33f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:15:27.449894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:27.449894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:27.449894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:27.449894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:27.449894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:27.449894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:27.449894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:27.449894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:27.449894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:27.449894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:27.449894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:27.449894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:27.449894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:27.449894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:27.449894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:27.450934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:27.450934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:27.450934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:27.450934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:27.450934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:27.450934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:27.450934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:27.450934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:27.450934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:27.450934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:27.450934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:27.450934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:27.450934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:27.450934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:27.450934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:27.450934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:27.451787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:27.451787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:27.451787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:27.451787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:27.451787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:27.451787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:27.451787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:27.451787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:27.451787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:27.451787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:27.451787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:15:27.451787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:27.451787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 603/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:15:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:27.457952 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb580fb-3c2d-45d4-8c45-49a617bfc89b None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:27.561793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb580fb-3c2d-45d4-8c45-49a617bfc89b None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:27.586989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:27.599202 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da13ad-c4c7-42c3-8fa6-9c1b970f64d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:27.599809 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da13ad-c4c7-42c3-8fa6-9c1b970f64d2 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:27.600082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da13ad-c4c7-42c3-8fa6-9c1b970f64d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:27.600355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da13ad-c4c7-42c3-8fa6-9c1b970f64d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:27.601012 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da13ad-c4c7-42c3-8fa6-9c1b970f64d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:27.601313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da13ad-c4c7-42c3-8fa6-9c1b970f64d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:27.602709 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da13ad-c4c7-42c3-8fa6-9c1b970f64d2 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:27.611317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 620/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:15:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:27.617195 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90fb3b-c31c-445c-a257-95a630f9b33f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:27.666158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:27.728454 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90fb3b-c31c-445c-a257-95a630f9b33f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:27.764622 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda6594-c7a1-44f6-9b93-82804fe358e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:27.765299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda6594-c7a1-44f6-9b93-82804fe358e5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:27.766106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda6594-c7a1-44f6-9b93-82804fe358e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:27.766400 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda6594-c7a1-44f6-9b93-82804fe358e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:27.777065 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda6594-c7a1-44f6-9b93-82804fe358e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:27.778608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda6594-c7a1-44f6-9b93-82804fe358e5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:27.794786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-6dda6594-c7a1-44f6-9b93-82804fe358e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:27.794786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:27.794786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:27.794786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:27.794786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:27.794786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:27.794786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:27.794786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:27.794786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:27.794786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:27.794786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:27.794786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:27.794786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:15:27.794786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:15:27.794786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:15:27.794786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:15:27.796007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:27.796007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:27.796007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:27.796007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:27.796007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:27.796007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:27.796007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:27.796007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:27.796007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:27.796007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:27.796007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:27.796007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:27.796007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:27.796007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:27.796007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:27.796007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:27.796007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:15:27.797140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:15:27.797140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:27.797140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:27.797140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 604/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:27.801971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da13ad-c4c7-42c3-8fa6-9c1b970f64d2 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:27.913681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da13ad-c4c7-42c3-8fa6-9c1b970f64d2 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:27.950049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb7997-2ab7-4a73-8639-bffc1c78dd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:27.950680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb7997-2ab7-4a73-8639-bffc1c78dd9e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:27.950961 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb7997-2ab7-4a73-8639-bffc1c78dd9e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:27.951234 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb7997-2ab7-4a73-8639-bffc1c78dd9e None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:27.951883 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb7997-2ab7-4a73-8639-bffc1c78dd9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:27.952182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb7997-2ab7-4a73-8639-bffc1c78dd9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:27.953999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddb7997-2ab7-4a73-8639-bffc1c78dd9e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:27.967568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 621/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:27.974979 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda6594-c7a1-44f6-9b93-82804fe358e5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:28.083990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:28.092589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda6594-c7a1-44f6-9b93-82804fe358e5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:28.128920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306246f1-2e6f-4b0c-9df6-4115e14e193b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:28.129643 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306246f1-2e6f-4b0c-9df6-4115e14e193b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:28.129920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306246f1-2e6f-4b0c-9df6-4115e14e193b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:28.130233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306246f1-2e6f-4b0c-9df6-4115e14e193b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:28.137917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306246f1-2e6f-4b0c-9df6-4115e14e193b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:28.139360 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306246f1-2e6f-4b0c-9df6-4115e14e193b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:28.150440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-306246f1-2e6f-4b0c-9df6-4115e14e193b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:15:28.150440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:28.150440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:28.150440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:28.150440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:28.150440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:28.150440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:28.150440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:28.150440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:28.150440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:28.150440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:28.150440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:28.150440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:15:28.150440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:15:28.150440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:15:28.150440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:15:28.151641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:28.151641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:28.151641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:15:28.151641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:15:28.151641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:15:28.151641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:15:28.151641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:28.151641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:28.151641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:28.151641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:28.151641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:28.151641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:28.151641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:28.151641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:28.151641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:28.151641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:28.151641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:28.151641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:28.152770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:28.152770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:28.152770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:15:28.152770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:15:28.152770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:15:28.152770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:15:28.152770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:15:28.152770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:15:28.152770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:15:28.152770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:28.152770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 605/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:28.158253 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb7997-2ab7-4a73-8639-bffc1c78dd9e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:28.213721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:28.276457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb7997-2ab7-4a73-8639-bffc1c78dd9e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:28.320391 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8652e-5865-4d3c-92da-d8c895a3ae86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:28.320995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8652e-5865-4d3c-92da-d8c895a3ae86 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:28.321260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8652e-5865-4d3c-92da-d8c895a3ae86 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:28.321537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8652e-5865-4d3c-92da-d8c895a3ae86 None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:28.322291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8652e-5865-4d3c-92da-d8c895a3ae86 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:28.322595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8652e-5865-4d3c-92da-d8c895a3ae86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:28.324020 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8652e-5865-4d3c-92da-d8c895a3ae86 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:28.347508 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 622/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 23 16:15:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:28.348577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306246f1-2e6f-4b0c-9df6-4115e14e193b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:28.460920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306246f1-2e6f-4b0c-9df6-4115e14e193b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:28.496977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc577c-1d0d-4a2c-913c-e28c79dae988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:28.497630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc577c-1d0d-4a2c-913c-e28c79dae988 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:28.497932 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc577c-1d0d-4a2c-913c-e28c79dae988 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:28.498230 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc577c-1d0d-4a2c-913c-e28c79dae988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:28.509416 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc577c-1d0d-4a2c-913c-e28c79dae988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:28.510867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc577c-1d0d-4a2c-913c-e28c79dae988 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:28.525722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-46cc577c-1d0d-4a2c-913c-e28c79dae988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:28.525722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:28.525722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:28.525722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:28.525722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:28.525722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:28.525722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:28.525722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:28.525722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:28.525722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:28.525722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:28.525722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:28.525722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:15:28.525722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:15:28.525722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:15:28.525722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:15:28.526754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:28.526754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:28.526754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:28.526754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:28.526754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:28.526754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:28.526754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:28.526754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:28.526754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:28.526754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:28.526754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:28.526754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:28.526754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:28.526754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:28.526754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:28.526754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:28.526754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:15:28.527644 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:15:28.527644 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:28.527644 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:28.527644 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 606/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:15:28.534110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8652e-5865-4d3c-92da-d8c895a3ae86 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:28.649334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8652e-5865-4d3c-92da-d8c895a3ae86 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:28.651615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:28.688097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de2549-d7d7-4369-a5a7-330739566669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:28.688752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de2549-d7d7-4369-a5a7-330739566669 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:28.688979 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de2549-d7d7-4369-a5a7-330739566669 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:28.689251 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de2549-d7d7-4369-a5a7-330739566669 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:28.689903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de2549-d7d7-4369-a5a7-330739566669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:28.690222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de2549-d7d7-4369-a5a7-330739566669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:28.691589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de2549-d7d7-4369-a5a7-330739566669 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:28.703050 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 623/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:28.708984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc577c-1d0d-4a2c-913c-e28c79dae988 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:28.721542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:28.821683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc577c-1d0d-4a2c-913c-e28c79dae988 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:28.855751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5176f62-56dd-4b69-97eb-ed5279f3daf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:28.856463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5176f62-56dd-4b69-97eb-ed5279f3daf1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:28.856736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5176f62-56dd-4b69-97eb-ed5279f3daf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:28.857021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5176f62-56dd-4b69-97eb-ed5279f3daf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:28.864529 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5176f62-56dd-4b69-97eb-ed5279f3daf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:28.865948 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5176f62-56dd-4b69-97eb-ed5279f3daf1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:28.877987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b5176f62-56dd-4b69-97eb-ed5279f3daf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:15:28.877987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:28.877987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:28.877987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:28.877987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:28.877987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:28.877987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:28.877987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:28.877987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:28.877987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:28.877987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:28.877987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:28.877987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:15:28.877987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:15:28.877987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:15:28.879093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:15:28.879093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:28.879093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:28.879093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:28.879093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:28.879093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:28.879093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:28.879093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:28.879093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:28.879093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:28.879093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:28.879093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:28.879093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:28.879093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:28.879093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:28.879093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:28.879093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:28.880307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:15:28.880307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:15:28.880307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:15:28.880307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:15:28.880307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:15:28.880307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:15:28.880307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:15:28.880307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:28.880307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 607/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:15:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:15:28.885514 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de2549-d7d7-4369-a5a7-330739566669 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:28.999195 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de2549-d7d7-4369-a5a7-330739566669 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:29.035659 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fed6c9-3093-4e39-ab1b-8618bec848c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:29.036465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fed6c9-3093-4e39-ab1b-8618bec848c6 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:29.036792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fed6c9-3093-4e39-ab1b-8618bec848c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:29.037069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fed6c9-3093-4e39-ab1b-8618bec848c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:29.037765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fed6c9-3093-4e39-ab1b-8618bec848c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:29.038087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fed6c9-3093-4e39-ab1b-8618bec848c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:29.039546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fed6c9-3093-4e39-ab1b-8618bec848c6 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:29.057720 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 624/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:15:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:29.064712 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5176f62-56dd-4b69-97eb-ed5279f3daf1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:29.131252 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:29.167627 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5176f62-56dd-4b69-97eb-ed5279f3daf1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:29.204983 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd831f-ccc3-4083-858e-ac8a32f74366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:29.205662 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd831f-ccc3-4083-858e-ac8a32f74366 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:29.205947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd831f-ccc3-4083-858e-ac8a32f74366 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:29.206288 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd831f-ccc3-4083-858e-ac8a32f74366 None admin] PATH_INFO: `/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/9cd1309c315e49eea6af4691d14c3e90/roles/bbf63b75406649a3b653308ecb75062d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:29.222458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd831f-ccc3-4083-858e-ac8a32f74366 None admin] RBAC: Authorizing `identity:create_grant(project_id=15a0439c9dd3406f81e2740fe775782b, user_id=9cd1309c315e49eea6af4691d14c3e90, role_id=bbf63b75406649a3b653308ecb75062d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:29.224273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd831f-ccc3-4083-858e-ac8a32f74366 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:29.239251 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 608/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:15:29 2022] PUT /identity/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/9cd1309c315e49eea6af4691d14c3e90/roles/bbf63b75406649a3b653308ecb75062d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:15:31.194861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc4144-0e15-42b4-b2dc-f37cd41a59b1 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:31.195362 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc4144-0e15-42b4-b2dc-f37cd41a59b1 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:31.195562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc4144-0e15-42b4-b2dc-f37cd41a59b1 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:31.196802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 625/1233] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:31.202665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25467118-5513-42be-9f73-a282a09b86cc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:31.203160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25467118-5513-42be-9f73-a282a09b86cc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:31.203474 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25467118-5513-42be-9f73-a282a09b86cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:31.221705 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-25467118-5513-42be-9f73-a282a09b86cc None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:31.222989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-25467118-5513-42be-9f73-a282a09b86cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:31.296377 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 609/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:15:31.580019 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc4144-0e15-42b4-b2dc-f37cd41a59b1 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:31.609738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:31.695767 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc4144-0e15-42b4-b2dc-f37cd41a59b1 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:31.736409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d9a9e-a7f0-4dc2-afbd-9742e9eacbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:31.737392 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d9a9e-a7f0-4dc2-afbd-9742e9eacbb7 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:31.737392 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d9a9e-a7f0-4dc2-afbd-9742e9eacbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:31.737578 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d9a9e-a7f0-4dc2-afbd-9742e9eacbb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:31.748083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d9a9e-a7f0-4dc2-afbd-9742e9eacbb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:31.753268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-330d9a9e-a7f0-4dc2-afbd-9742e9eacbb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:15:31.753268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:31.753268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:31.753268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:31.753268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:31.753268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:31.753268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:31.753268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:31.753268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:31.753268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:31.753268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:31.753268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:31.753268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:31.753268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:31.753268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:31.753268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:31.754525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:31.754525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:31.754525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:31.754525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:31.754525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:31.754525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:31.754525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:31.754525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:31.754525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:31.754525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:31.754525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:31.754525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:31.754525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:31.754525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:31.754525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:31.754525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:31.755794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:31.755794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:31.755794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:31.755794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:31.755794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:31.755794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:31.755794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:31.755794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:31.755794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:31.755794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:31.755794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 16:15:31.755794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:15:31.755794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 626/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 16:15:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:15:31.760753 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25467118-5513-42be-9f73-a282a09b86cc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:31.808480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:31.869411 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25467118-5513-42be-9f73-a282a09b86cc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:31.906797 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cf97d-b525-49bf-ab09-d051710db002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:31.907591 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cf97d-b525-49bf-ab09-d051710db002 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:31.907887 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cf97d-b525-49bf-ab09-d051710db002 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:31.908167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cf97d-b525-49bf-ab09-d051710db002 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:31.908871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cf97d-b525-49bf-ab09-d051710db002 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:31.909171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cf97d-b525-49bf-ab09-d051710db002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:31.910602 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cf97d-b525-49bf-ab09-d051710db002 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:31.919424 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 610/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 16:15:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:31.926043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d9a9e-a7f0-4dc2-afbd-9742e9eacbb7 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:32.020885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:32.039487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d9a9e-a7f0-4dc2-afbd-9742e9eacbb7 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:32.075700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef7306-2260-49b3-a642-709d4a54522e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:32.076328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef7306-2260-49b3-a642-709d4a54522e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:32.076604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef7306-2260-49b3-a642-709d4a54522e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:32.076872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef7306-2260-49b3-a642-709d4a54522e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:32.088036 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef7306-2260-49b3-a642-709d4a54522e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:32.089683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef7306-2260-49b3-a642-709d4a54522e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:32.105811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-60ef7306-2260-49b3-a642-709d4a54522e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:32.105811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:32.105811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:32.105811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:32.105811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:32.105811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:32.105811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:32.105811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:32.105811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:32.105811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:32.105811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:32.105811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:32.105811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:15:32.105811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:15:32.105811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:15:32.105811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:15:32.106904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:32.106904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:32.106904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:32.106904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:32.106904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:32.106904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:32.106904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:32.106904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:32.106904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:32.106904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:32.106904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:32.106904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:32.106904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:32.106904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:32.106904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:32.106904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:32.106904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:15:32.108020 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:15:32.108020 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:32.108020 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:15:32.108020 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 627/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:32.113703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cf97d-b525-49bf-ab09-d051710db002 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:32.227365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cf97d-b525-49bf-ab09-d051710db002 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:32.237348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:32.269008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ce48c-193e-409c-bee4-d784936983b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:32.269710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ce48c-193e-409c-bee4-d784936983b3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:32.270212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ce48c-193e-409c-bee4-d784936983b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:32.270435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ce48c-193e-409c-bee4-d784936983b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:32.271105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ce48c-193e-409c-bee4-d784936983b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:32.271454 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ce48c-193e-409c-bee4-d784936983b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:32.273010 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ce48c-193e-409c-bee4-d784936983b3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:32.288903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 611/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:32.294928 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef7306-2260-49b3-a642-709d4a54522e None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:32.403019 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef7306-2260-49b3-a642-709d4a54522e None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:32.444645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbd5ea-4da2-4162-b462-97a56571f830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:32.445209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbd5ea-4da2-4162-b462-97a56571f830 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:32.445489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbd5ea-4da2-4162-b462-97a56571f830 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:32.445762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbd5ea-4da2-4162-b462-97a56571f830 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:32.448480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:32.454108 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cbd5ea-4da2-4162-b462-97a56571f830 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:32.455785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cbd5ea-4da2-4162-b462-97a56571f830 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:32.467102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-f4cbd5ea-4da2-4162-b462-97a56571f830 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:15:32.467102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:32.467102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:32.467102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:32.467102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:32.467102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:32.467102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:32.467102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:32.467102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:32.467102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:32.467102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:32.467102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:32.467102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:15:32.467102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:15:32.467102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:15:32.467102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:15:32.468973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:32.468973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:32.468973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:15:32.468973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:15:32.468973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:15:32.468973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:15:32.468973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:32.468973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:32.468973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:32.468973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:32.468973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:32.468973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:32.468973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:32.468973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:32.468973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:32.468973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:32.468973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:32.468973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:32.470128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:32.470128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:32.470128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:15:32.470128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:15:32.470128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:15:32.470128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:15:32.470128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:15:32.470128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:15:32.470128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:15:32.470128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:15:32.470128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 628/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:32.475377 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ce48c-193e-409c-bee4-d784936983b3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:32.592926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ce48c-193e-409c-bee4-d784936983b3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:32.630316 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fecf5-8d33-4365-944d-931422559ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:32.630929 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fecf5-8d33-4365-944d-931422559ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:32.631213 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fecf5-8d33-4365-944d-931422559ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:32.631485 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fecf5-8d33-4365-944d-931422559ec1 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:32.632214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fecf5-8d33-4365-944d-931422559ec1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:32.632525 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fecf5-8d33-4365-944d-931422559ec1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:32.633955 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fecf5-8d33-4365-944d-931422559ec1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:32.652858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 612/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 23 16:15:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:32.659557 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbd5ea-4da2-4162-b462-97a56571f830 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:32.780840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbd5ea-4da2-4162-b462-97a56571f830 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:32.819860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19839414-f57b-4cdf-b487-d98b7f991621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:32.820472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19839414-f57b-4cdf-b487-d98b7f991621 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:32.820758 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19839414-f57b-4cdf-b487-d98b7f991621 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:32.821023 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19839414-f57b-4cdf-b487-d98b7f991621 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:32.888969 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:32.896556 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19839414-f57b-4cdf-b487-d98b7f991621 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:32.898915 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19839414-f57b-4cdf-b487-d98b7f991621 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:33.009716 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 629/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 16:15:33.015738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fecf5-8d33-4365-944d-931422559ec1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:33.046374 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:33.124108 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fecf5-8d33-4365-944d-931422559ec1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:33.164565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1059af-84a7-48e9-bd50-0207845edb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:33.165202 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1059af-84a7-48e9-bd50-0207845edb0a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:33.165482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1059af-84a7-48e9-bd50-0207845edb0a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:33.165755 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1059af-84a7-48e9-bd50-0207845edb0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:33.176235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1059af-84a7-48e9-bd50-0207845edb0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:33.177676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1059af-84a7-48e9-bd50-0207845edb0a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:33.192699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5a1059af-84a7-48e9-bd50-0207845edb0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:33.192699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:33.192699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:33.192699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:33.192699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:33.192699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:33.192699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:33.192699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:33.192699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:33.192699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:33.192699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:33.192699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:33.192699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:15:33.192699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:15:33.192699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:15:33.192699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:15:33.193880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:33.193880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:33.193880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:33.193880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:33.193880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:33.193880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:33.193880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:33.193880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:33.193880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:33.193880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:33.193880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:33.193880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:33.193880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:33.193880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:33.193880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:33.193880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:33.193880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:15:33.195039 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:15:33.195039 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:33.195039 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:33.195039 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 613/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:15:33.199782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19839414-f57b-4cdf-b487-d98b7f991621 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:33.304376 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:33.310662 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19839414-f57b-4cdf-b487-d98b7f991621 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:33.350892 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4541d2-ac45-4e2d-a396-fef78892bc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:33.351492 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4541d2-ac45-4e2d-a396-fef78892bc0b None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:33.351768 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4541d2-ac45-4e2d-a396-fef78892bc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:33.352036 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4541d2-ac45-4e2d-a396-fef78892bc0b None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:33.352672 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4541d2-ac45-4e2d-a396-fef78892bc0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:33.352972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4541d2-ac45-4e2d-a396-fef78892bc0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:33.354405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4541d2-ac45-4e2d-a396-fef78892bc0b None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:33.367250 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 630/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:33.373413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1059af-84a7-48e9-bd50-0207845edb0a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:33.458529 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:33.481450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1059af-84a7-48e9-bd50-0207845edb0a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:33.516723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a106b-0a1f-4d62-b219-d78d4d96f782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:33.517357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a106b-0a1f-4d62-b219-d78d4d96f782 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:33.517646 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a106b-0a1f-4d62-b219-d78d4d96f782 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:33.517912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a106b-0a1f-4d62-b219-d78d4d96f782 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:33.524742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a106b-0a1f-4d62-b219-d78d4d96f782 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:33.526207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a106b-0a1f-4d62-b219-d78d4d96f782 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:33.537704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-0c9a106b-0a1f-4d62-b219-d78d4d96f782 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:15:33.537704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:33.537704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:33.537704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:33.537704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:33.537704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:33.537704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:33.537704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:33.537704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:33.537704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:33.537704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:33.537704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:33.537704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:15:33.537704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:15:33.537704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:15:33.544303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:15:33.544303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:33.544303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:33.544303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:33.544303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:33.544303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:33.544303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:33.544303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:33.544303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:33.544303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:33.544303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:33.544303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:33.544303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:33.544303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:33.544303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:33.544303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:33.544303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:33.545440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:15:33.545440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:15:33.545440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:15:33.545440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:15:33.545440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:15:33.545440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:15:33.545440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:15:33.545440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:33.545440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 614/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:15:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:33.546081 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4541d2-ac45-4e2d-a396-fef78892bc0b None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:33.664581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4541d2-ac45-4e2d-a396-fef78892bc0b None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:33.703579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5e359-3df4-4fa1-9f32-21c04cfd8b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:33.704296 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5e359-3df4-4fa1-9f32-21c04cfd8b6a None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:33.704617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5e359-3df4-4fa1-9f32-21c04cfd8b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:33.704955 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5e359-3df4-4fa1-9f32-21c04cfd8b6a None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:33.705737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5e359-3df4-4fa1-9f32-21c04cfd8b6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:33.706080 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5e359-3df4-4fa1-9f32-21c04cfd8b6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:33.707632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5e359-3df4-4fa1-9f32-21c04cfd8b6a None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:33.720261 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 631/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:15:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:33.726917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a106b-0a1f-4d62-b219-d78d4d96f782 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:33.837011 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a106b-0a1f-4d62-b219-d78d4d96f782 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:33.873224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b5356-e2c3-4a1b-b5e1-39ac69ab3c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:33.873869 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b5356-e2c3-4a1b-b5e1-39ac69ab3c6e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:33.874203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b5356-e2c3-4a1b-b5e1-39ac69ab3c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:33.874458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b5356-e2c3-4a1b-b5e1-39ac69ab3c6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:33.875398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b5356-e2c3-4a1b-b5e1-39ac69ab3c6e None admin] RBAC: Adding query filter params (role.id=bbf63b75406649a3b653308ecb75062d, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=9cd1309c315e49eea6af4691d14c3e90) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:33.875762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b5356-e2c3-4a1b-b5e1-39ac69ab3c6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:33.877408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b5356-e2c3-4a1b-b5e1-39ac69ab3c6e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:33.883668 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 615/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:15:33 2022] GET /identity/v3/role_assignments?user.id=9cd1309c315e49eea6af4691d14c3e90&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=bbf63b75406649a3b653308ecb75062d => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:36.029055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf921-5a82-4468-9857-8b4cbfabcaaf None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:36.029645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf921-5a82-4468-9857-8b4cbfabcaaf None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:36.029645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf921-5a82-4468-9857-8b4cbfabcaaf None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:36.031715 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 632/1247] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:36.037546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0372da-5730-405c-81f2-264be8833cf5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:36.038137 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0372da-5730-405c-81f2-264be8833cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:36.038234 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0372da-5730-405c-81f2-264be8833cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:36.045300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:36.059340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5d0372da-5730-405c-81f2-264be8833cf5 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:36.060775 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5d0372da-5730-405c-81f2-264be8833cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:36.141210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 616/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 16:15:36.424229 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bf921-5a82-4468-9857-8b4cbfabcaaf None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:36.445481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:36.543859 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bf921-5a82-4468-9857-8b4cbfabcaaf None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:36.584428 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5682fa-b4b9-4ef9-b157-ccf5a75c38a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:36.585337 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5682fa-b4b9-4ef9-b157-ccf5a75c38a3 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:36.585672 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5682fa-b4b9-4ef9-b157-ccf5a75c38a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:36.586131 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5682fa-b4b9-4ef9-b157-ccf5a75c38a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:36.600449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5682fa-b4b9-4ef9-b157-ccf5a75c38a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:36.606838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-0c5682fa-b4b9-4ef9-b157-ccf5a75c38a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:36.606838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:36.606838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:36.606838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:36.606838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:36.606838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:36.606838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:36.606838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:36.606838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:36.606838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:36.606838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:36.606838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:36.606838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:36.606838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:36.606838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:36.606838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:36.608333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:36.608333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:36.608333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:36.608333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:36.608333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:36.608333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:36.608333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:36.608333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:36.608333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:36.608333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:36.608333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:36.608333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:36.608333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:36.608333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:36.608333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:36.608333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:36.609951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:36.609951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:36.609951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:36.609951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:36.609951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:36.609951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:36.609951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:36.609951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:36.609951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:36.609951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:36.609951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:36.609951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:15:36.609951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 633/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:15:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:36.616936 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0372da-5730-405c-81f2-264be8833cf5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:36.732380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0372da-5730-405c-81f2-264be8833cf5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:36.765386 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:36.771315 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900890f-fab0-4859-bbd5-bfccfde7a01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:36.772028 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900890f-fab0-4859-bbd5-bfccfde7a01d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:36.772344 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900890f-fab0-4859-bbd5-bfccfde7a01d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:36.772676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900890f-fab0-4859-bbd5-bfccfde7a01d None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:36.773424 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900890f-fab0-4859-bbd5-bfccfde7a01d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:36.773705 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900890f-fab0-4859-bbd5-bfccfde7a01d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:36.775106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900890f-fab0-4859-bbd5-bfccfde7a01d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:36.785458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 617/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:36.792075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5682fa-b4b9-4ef9-b157-ccf5a75c38a3 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:36.887547 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:36.912260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5682fa-b4b9-4ef9-b157-ccf5a75c38a3 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:36.950239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461811e-dada-4421-be63-69656ca33547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:36.951128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461811e-dada-4421-be63-69656ca33547 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:36.951407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461811e-dada-4421-be63-69656ca33547 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:36.951697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461811e-dada-4421-be63-69656ca33547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:36.962902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461811e-dada-4421-be63-69656ca33547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:36.964373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461811e-dada-4421-be63-69656ca33547 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:36.981980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-a461811e-dada-4421-be63-69656ca33547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:36.981980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:36.981980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:36.981980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:36.981980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:36.981980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:36.981980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:36.981980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:36.981980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:36.981980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:36.981980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:36.981980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:36.981980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:15:36.981980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:15:36.981980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:15:36.981980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:15:36.983397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:36.983397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:36.983397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:36.983397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:36.983397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:36.983397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:36.983397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:36.983397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:36.983397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:36.983397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:36.983397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:36.983397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:36.983397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:36.983397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:36.983397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:36.983397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:36.983397 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:15:36.985556 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:15:36.985556 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:36.985556 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:15:36.985556 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 634/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:36.990633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900890f-fab0-4859-bbd5-bfccfde7a01d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:37.119293 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900890f-fab0-4859-bbd5-bfccfde7a01d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:37.158544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09099986-bb43-4316-8757-59fcdb87e344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:37.159481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09099986-bb43-4316-8757-59fcdb87e344 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:37.159761 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09099986-bb43-4316-8757-59fcdb87e344 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:37.160065 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09099986-bb43-4316-8757-59fcdb87e344 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:37.160705 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09099986-bb43-4316-8757-59fcdb87e344 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:37.161005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09099986-bb43-4316-8757-59fcdb87e344 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:37.162440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09099986-bb43-4316-8757-59fcdb87e344 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:37.176405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 618/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:37.182821 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461811e-dada-4421-be63-69656ca33547 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:37.297394 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461811e-dada-4421-be63-69656ca33547 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:37.325414 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:37.335238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0de4e4-1cb7-42a7-bc8e-4406fb715021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:37.335986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0de4e4-1cb7-42a7-bc8e-4406fb715021 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:37.336270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0de4e4-1cb7-42a7-bc8e-4406fb715021 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:37.336627 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0de4e4-1cb7-42a7-bc8e-4406fb715021 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:37.346944 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0de4e4-1cb7-42a7-bc8e-4406fb715021 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:37.348696 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0de4e4-1cb7-42a7-bc8e-4406fb715021 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:37.360666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-da0de4e4-1cb7-42a7-bc8e-4406fb715021 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:15:37.360666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:37.360666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:37.360666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:37.360666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:37.360666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:37.360666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:37.360666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:37.360666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:37.360666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:37.360666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:37.360666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:37.360666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:15:37.360666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:15:37.360666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:15:37.360666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:15:37.361847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:37.361847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:37.361847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:15:37.361847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:15:37.361847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:15:37.361847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:15:37.361847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:37.361847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:37.361847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:37.361847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:37.361847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:37.361847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:37.361847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:37.361847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:37.361847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:37.361847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:37.361847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:37.361847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:37.363236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:37.363236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:37.363236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:15:37.363236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:15:37.363236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:15:37.363236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:15:37.363236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:15:37.363236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:15:37.363236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:15:37.363236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:15:37.363236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 635/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:37.367609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09099986-bb43-4316-8757-59fcdb87e344 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:37.428096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:37.481323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09099986-bb43-4316-8757-59fcdb87e344 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:37.522533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e3a99-37cf-4919-b543-624727e2f562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:37.523150 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e3a99-37cf-4919-b543-624727e2f562 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:37.523461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e3a99-37cf-4919-b543-624727e2f562 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:37.523700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e3a99-37cf-4919-b543-624727e2f562 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:37.524431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e3a99-37cf-4919-b543-624727e2f562 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:37.524770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e3a99-37cf-4919-b543-624727e2f562 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:37.526190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e3a99-37cf-4919-b543-624727e2f562 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:37.545292 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 619/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 23 16:15:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:37.551472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0de4e4-1cb7-42a7-bc8e-4406fb715021 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:37.668501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0de4e4-1cb7-42a7-bc8e-4406fb715021 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:37.708856 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac0c81-1393-4a70-bc7c-34c2e8a287c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:37.709479 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac0c81-1393-4a70-bc7c-34c2e8a287c6 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:37.709767 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac0c81-1393-4a70-bc7c-34c2e8a287c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:37.710043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac0c81-1393-4a70-bc7c-34c2e8a287c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:37.770759 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:37.787136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac0c81-1393-4a70-bc7c-34c2e8a287c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:37.788797 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac0c81-1393-4a70-bc7c-34c2e8a287c6 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:37.898033 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 636/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 16:15:37.904535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e3a99-37cf-4919-b543-624727e2f562 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:38.008731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e3a99-37cf-4919-b543-624727e2f562 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:38.024925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:38.048187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83094f49-2add-4ab2-a78f-8f742c96e351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:38.048806 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83094f49-2add-4ab2-a78f-8f742c96e351 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:38.049083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83094f49-2add-4ab2-a78f-8f742c96e351 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:38.049364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83094f49-2add-4ab2-a78f-8f742c96e351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:38.060382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83094f49-2add-4ab2-a78f-8f742c96e351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:38.062089 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83094f49-2add-4ab2-a78f-8f742c96e351 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:38.079965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-83094f49-2add-4ab2-a78f-8f742c96e351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:38.079965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:38.079965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:38.079965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:38.079965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:38.079965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:38.079965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:38.079965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:38.079965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:38.079965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:38.079965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:38.079965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:38.079965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:15:38.079965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:15:38.079965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:15:38.079965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:15:38.081162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:38.081162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:38.081162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:38.081162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:38.081162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:38.081162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:38.081162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:38.081162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:38.081162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:38.081162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:38.081162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:38.081162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:38.081162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:38.081162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:38.081162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:38.081162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:38.081162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:15:38.082294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:15:38.082294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:38.082294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:38.082294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 620/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:38.087615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac0c81-1393-4a70-bc7c-34c2e8a287c6 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:38.187564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:38.202955 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac0c81-1393-4a70-bc7c-34c2e8a287c6 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:38.240727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce409a32-c821-4ad4-b70a-f1c62ad1720f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:38.241331 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce409a32-c821-4ad4-b70a-f1c62ad1720f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:38.241608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce409a32-c821-4ad4-b70a-f1c62ad1720f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:38.241880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce409a32-c821-4ad4-b70a-f1c62ad1720f None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:38.242552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce409a32-c821-4ad4-b70a-f1c62ad1720f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:38.242854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce409a32-c821-4ad4-b70a-f1c62ad1720f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:38.244227 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce409a32-c821-4ad4-b70a-f1c62ad1720f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:38.256234 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 637/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:38.262058 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83094f49-2add-4ab2-a78f-8f742c96e351 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:38.380484 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83094f49-2add-4ab2-a78f-8f742c96e351 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:38.424967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c8e96-9a05-4b0c-9c3f-3583609230cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:38.425623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c8e96-9a05-4b0c-9c3f-3583609230cc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:38.425901 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c8e96-9a05-4b0c-9c3f-3583609230cc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:38.426204 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c8e96-9a05-4b0c-9c3f-3583609230cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:38.433917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c8e96-9a05-4b0c-9c3f-3583609230cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:38.435322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c8e96-9a05-4b0c-9c3f-3583609230cc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:38.448349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-d60c8e96-9a05-4b0c-9c3f-3583609230cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:15:38.448349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:38.448349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:38.448349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:38.448349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:38.448349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:38.448349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:38.448349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:38.448349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:38.448349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:38.448349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:38.448349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:38.448349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:15:38.448349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:15:38.448349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:15:38.449481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:15:38.449481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:38.449481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:38.449481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:38.449481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:38.449481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:38.449481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:38.449481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:38.449481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:38.449481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:38.449481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:38.449481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:38.449481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:38.449481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:38.449481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:38.449481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:38.449481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:38.450434 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:15:38.450434 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:15:38.450434 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:15:38.450434 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:15:38.450434 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:15:38.450434 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:15:38.450434 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:15:38.450434 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:38.450434 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 621/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:15:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:15:38.455922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce409a32-c821-4ad4-b70a-f1c62ad1720f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:38.566503 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce409a32-c821-4ad4-b70a-f1c62ad1720f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:38.605783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f7870-24c6-4024-8b5c-26f0a3fbbd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:38.606428 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f7870-24c6-4024-8b5c-26f0a3fbbd3e None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:38.606712 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f7870-24c6-4024-8b5c-26f0a3fbbd3e None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:38.606987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f7870-24c6-4024-8b5c-26f0a3fbbd3e None admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:38.607722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f7870-24c6-4024-8b5c-26f0a3fbbd3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:38.608031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f7870-24c6-4024-8b5c-26f0a3fbbd3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:38.610119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f7870-24c6-4024-8b5c-26f0a3fbbd3e None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:38.623369 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 638/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:15:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:38.630207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c8e96-9a05-4b0c-9c3f-3583609230cc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:38.658630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:38.738633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c8e96-9a05-4b0c-9c3f-3583609230cc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:38.774595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd4544-de33-4ac8-83cf-6a05b6c61e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:38.775215 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd4544-de33-4ac8-83cf-6a05b6c61e0e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:38.775494 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd4544-de33-4ac8-83cf-6a05b6c61e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:38.775764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd4544-de33-4ac8-83cf-6a05b6c61e0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:38.776501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd4544-de33-4ac8-83cf-6a05b6c61e0e None admin] RBAC: Adding query filter params (role.id=8de0c87242d7426ea25a510b578c02aa, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=9cd1309c315e49eea6af4691d14c3e90) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:38.776808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd4544-de33-4ac8-83cf-6a05b6c61e0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:38.778268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd4544-de33-4ac8-83cf-6a05b6c61e0e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:38.785186 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 622/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:15:38 2022] GET /identity/v3/role_assignments?user.id=9cd1309c315e49eea6af4691d14c3e90&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=8de0c87242d7426ea25a510b578c02aa => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:40.701680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67de80b-ceea-4e5a-8174-27d057cc6bd4 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:40.702310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67de80b-ceea-4e5a-8174-27d057cc6bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:40.702399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67de80b-ceea-4e5a-8174-27d057cc6bd4 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:40.703911 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 639/1261] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:40.708987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c88809-b622-4ec4-97ad-764f84709728 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:40.709435 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c88809-b622-4ec4-97ad-764f84709728 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:40.709571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c88809-b622-4ec4-97ad-764f84709728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:40.727775 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-57c88809-b622-4ec4-97ad-764f84709728 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:40.728952 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-57c88809-b622-4ec4-97ad-764f84709728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:40.794307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 623/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:15:41.072211 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67de80b-ceea-4e5a-8174-27d057cc6bd4 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:41.083817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:41.175193 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67de80b-ceea-4e5a-8174-27d057cc6bd4 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:41.209651 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7764f6-7b72-4442-8555-ad2c8d45ed02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:41.210304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7764f6-7b72-4442-8555-ad2c8d45ed02 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:41.210587 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7764f6-7b72-4442-8555-ad2c8d45ed02 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:41.210861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7764f6-7b72-4442-8555-ad2c8d45ed02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:41.221284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7764f6-7b72-4442-8555-ad2c8d45ed02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:41.225914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-ac7764f6-7b72-4442-8555-ad2c8d45ed02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:41.225914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:41.225914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:41.225914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:41.225914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:41.225914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:41.225914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:41.225914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:41.225914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:41.225914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:41.225914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:41.225914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:41.225914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:41.225914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:41.225914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:41.225914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:41.227124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:41.227124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:41.227124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:41.227124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:41.227124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:41.227124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:41.227124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:41.227124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:41.227124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:41.227124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:41.227124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:41.227124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:41.227124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:41.227124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:41.227124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:41.227124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:41.228233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:41.228233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:41.228233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:41.228233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:41.228233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:41.228233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:41.228233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:41.228233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:41.228233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:41.228233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:41.228233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:41.228233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:15:41.228233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 640/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:15:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:41.233198 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c88809-b622-4ec4-97ad-764f84709728 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:41.251655 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:41.329930 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c88809-b622-4ec4-97ad-764f84709728 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:41.361338 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec43655-3d6e-4a15-bf82-68548dab79b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:41.361926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec43655-3d6e-4a15-bf82-68548dab79b7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:41.362233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec43655-3d6e-4a15-bf82-68548dab79b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:41.362507 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec43655-3d6e-4a15-bf82-68548dab79b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:41.363161 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec43655-3d6e-4a15-bf82-68548dab79b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:41.363460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec43655-3d6e-4a15-bf82-68548dab79b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:41.364812 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec43655-3d6e-4a15-bf82-68548dab79b7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:41.372438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 624/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:41.378822 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7764f6-7b72-4442-8555-ad2c8d45ed02 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:41.442792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:41.475125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7764f6-7b72-4442-8555-ad2c8d45ed02 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:41.507123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d7a43-8382-4399-816d-ef46fe51662f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:41.507732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d7a43-8382-4399-816d-ef46fe51662f None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:41.508007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d7a43-8382-4399-816d-ef46fe51662f None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:41.508273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d7a43-8382-4399-816d-ef46fe51662f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:41.519089 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d7a43-8382-4399-816d-ef46fe51662f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:41.520511 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d7a43-8382-4399-816d-ef46fe51662f None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:41.534355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-004d7a43-8382-4399-816d-ef46fe51662f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:41.534355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:41.534355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:41.534355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:41.534355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:41.534355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:41.534355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:41.534355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:41.534355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:41.534355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:41.534355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:41.534355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:41.534355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:15:41.534355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:15:41.534355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:15:41.534355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:15:41.535495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:41.535495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:41.535495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:41.535495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:41.535495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:41.535495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:41.535495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:41.535495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:41.535495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:41.535495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:41.535495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:41.535495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:41.535495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:41.535495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:41.535495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:41.535495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:41.535495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:15:41.536578 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:15:41.536578 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:41.536578 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:15:41.536578 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 641/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:41.541465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec43655-3d6e-4a15-bf82-68548dab79b7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:41.628220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:41.646692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec43655-3d6e-4a15-bf82-68548dab79b7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:41.679558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2902a-b3be-4687-900c-6f619cfd1bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:41.680151 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2902a-b3be-4687-900c-6f619cfd1bac None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:41.680432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2902a-b3be-4687-900c-6f619cfd1bac None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:41.680705 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2902a-b3be-4687-900c-6f619cfd1bac None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:41.681341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2902a-b3be-4687-900c-6f619cfd1bac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:41.681643 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2902a-b3be-4687-900c-6f619cfd1bac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:41.683023 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2902a-b3be-4687-900c-6f619cfd1bac None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:41.694867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 625/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:41.700632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d7a43-8382-4399-816d-ef46fe51662f None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:41.801203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d7a43-8382-4399-816d-ef46fe51662f None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:41.820238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:41.835165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cdda8-b1eb-4a46-9605-6a2048f5ca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:41.835777 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cdda8-b1eb-4a46-9605-6a2048f5ca0d None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:41.836053 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cdda8-b1eb-4a46-9605-6a2048f5ca0d None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:41.836322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cdda8-b1eb-4a46-9605-6a2048f5ca0d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:41.844576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cdda8-b1eb-4a46-9605-6a2048f5ca0d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:41.845998 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cdda8-b1eb-4a46-9605-6a2048f5ca0d None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:41.856713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-164cdda8-b1eb-4a46-9605-6a2048f5ca0d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:15:41.856713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:41.856713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:41.856713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:41.856713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:41.856713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:41.856713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:41.856713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:41.856713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:41.856713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:41.856713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:41.856713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:41.856713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:15:41.856713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:15:41.856713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:15:41.856713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:15:41.857837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:41.857837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:41.857837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:15:41.857837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:15:41.857837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:15:41.857837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:15:41.857837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:41.857837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:41.857837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:41.857837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:41.857837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:41.857837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:41.857837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:41.857837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:41.857837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:41.857837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:41.857837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:41.857837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:41.859982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:41.859982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:41.859982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:15:41.859982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:15:41.859982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:15:41.859982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:15:41.859982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:15:41.859982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:15:41.859982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:15:41.859982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:15:41.859982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 642/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:41.863779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2902a-b3be-4687-900c-6f619cfd1bac None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:41.959762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2902a-b3be-4687-900c-6f619cfd1bac None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:41.992078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e9bef-0924-4617-ac2a-d6993d4e0018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:41.992678 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e9bef-0924-4617-ac2a-d6993d4e0018 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:41.992958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e9bef-0924-4617-ac2a-d6993d4e0018 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:41.993228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e9bef-0924-4617-ac2a-d6993d4e0018 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:41.993952 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e9bef-0924-4617-ac2a-d6993d4e0018 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:41.994282 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e9bef-0924-4617-ac2a-d6993d4e0018 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:41.995693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e9bef-0924-4617-ac2a-d6993d4e0018 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:42.003963 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:42.012132 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 626/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 23 16:15:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:42.018705 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cdda8-b1eb-4a46-9605-6a2048f5ca0d None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:42.122452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cdda8-b1eb-4a46-9605-6a2048f5ca0d None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:42.156171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81c6ea-3d24-4b40-9a77-e5f98ba386be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:42.156896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81c6ea-3d24-4b40-9a77-e5f98ba386be None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:42.157176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81c6ea-3d24-4b40-9a77-e5f98ba386be None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:42.157448 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81c6ea-3d24-4b40-9a77-e5f98ba386be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:42.167806 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81c6ea-3d24-4b40-9a77-e5f98ba386be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:42.169228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81c6ea-3d24-4b40-9a77-e5f98ba386be None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:42.183737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-8f81c6ea-3d24-4b40-9a77-e5f98ba386be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:42.183737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:42.183737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:42.183737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:42.183737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:42.183737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:42.183737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:42.183737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:42.183737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:42.183737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:42.183737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:42.183737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:42.183737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:15:42.183737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:15:42.183737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:15:42.183737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:15:42.184922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:42.184922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:42.184922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:42.184922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:42.184922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:42.184922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:42.184922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:42.184922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:42.184922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:42.184922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:42.184922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:42.184922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:42.184922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:42.184922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:42.184922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:42.184922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:42.184922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:15:42.186223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:15:42.186223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:42.186223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:15:42.186223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 643/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:42.191010 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e9bef-0924-4617-ac2a-d6993d4e0018 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:42.287514 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e9bef-0924-4617-ac2a-d6993d4e0018 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:42.320490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47072263-664d-4aa6-8754-22152fe37bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:42.321097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47072263-664d-4aa6-8754-22152fe37bba None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:42.321379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47072263-664d-4aa6-8754-22152fe37bba None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:42.321656 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47072263-664d-4aa6-8754-22152fe37bba None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:42.322320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47072263-664d-4aa6-8754-22152fe37bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:42.322630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47072263-664d-4aa6-8754-22152fe37bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:42.323989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47072263-664d-4aa6-8754-22152fe37bba None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:42.335127 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 627/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:42.340734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81c6ea-3d24-4b40-9a77-e5f98ba386be None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:42.372904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:42.442500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81c6ea-3d24-4b40-9a77-e5f98ba386be None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:42.475667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5136edc-34d4-4dc6-9108-2cfe1b645868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:42.476282 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5136edc-34d4-4dc6-9108-2cfe1b645868 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:42.476563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5136edc-34d4-4dc6-9108-2cfe1b645868 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:42.476836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5136edc-34d4-4dc6-9108-2cfe1b645868 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:42.483216 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5136edc-34d4-4dc6-9108-2cfe1b645868 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:42.484671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5136edc-34d4-4dc6-9108-2cfe1b645868 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:42.496200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-f5136edc-34d4-4dc6-9108-2cfe1b645868 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:15:42.496200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:42.496200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:42.496200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:42.496200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:42.496200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:42.496200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:42.496200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:42.496200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:42.496200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:42.496200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:42.496200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:42.496200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:15:42.496200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:15:42.496200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:15:42.497102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:15:42.497102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:42.497102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:42.497102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:42.497102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:42.497102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:42.497102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:42.497102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:42.497102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:42.497102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:42.497102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:42.497102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:42.497102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:42.497102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:42.497102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:42.497102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:42.497102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:42.498081 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:15:42.498081 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:15:42.498081 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:15:42.498081 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:15:42.498081 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:15:42.498081 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:15:42.498081 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:15:42.498081 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:15:42.498081 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 644/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:15:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:42.503056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47072263-664d-4aa6-8754-22152fe37bba None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:42.563042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:42.604898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47072263-664d-4aa6-8754-22152fe37bba None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:42.637410 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f00cdb-43d5-4801-b47d-fadc514289d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:42.638001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f00cdb-43d5-4801-b47d-fadc514289d6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:42.638306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f00cdb-43d5-4801-b47d-fadc514289d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:42.638577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f00cdb-43d5-4801-b47d-fadc514289d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:42.639258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f00cdb-43d5-4801-b47d-fadc514289d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:42.639702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f00cdb-43d5-4801-b47d-fadc514289d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:42.641174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f00cdb-43d5-4801-b47d-fadc514289d6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:42.652582 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 628/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:15:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:42.659243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5136edc-34d4-4dc6-9108-2cfe1b645868 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:42.749570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:42.758454 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5136edc-34d4-4dc6-9108-2cfe1b645868 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:42.792770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cff7d-055b-40bc-84e6-154b29d4e099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:42.793408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cff7d-055b-40bc-84e6-154b29d4e099 None admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:42.793685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cff7d-055b-40bc-84e6-154b29d4e099 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:42.793955 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cff7d-055b-40bc-84e6-154b29d4e099 None admin] PATH_INFO: `/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/9cd1309c315e49eea6af4691d14c3e90/roles/8de0c87242d7426ea25a510b578c02aa` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:42.796458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cff7d-055b-40bc-84e6-154b29d4e099 None admin] RBAC: Authorizing `identity:create_grant(project_id=15a0439c9dd3406f81e2740fe775782b, user_id=9cd1309c315e49eea6af4691d14c3e90, role_id=8de0c87242d7426ea25a510b578c02aa)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:42.797979 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cff7d-055b-40bc-84e6-154b29d4e099 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:42.809987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 645/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 16:15:42 2022] PUT /identity/v3/projects/15a0439c9dd3406f81e2740fe775782b/users/9cd1309c315e49eea6af4691d14c3e90/roles/8de0c87242d7426ea25a510b578c02aa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:15:44.689297 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d7d2-1bf3-414c-8262-b7eaf267f938 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:44.689874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d7d2-1bf3-414c-8262-b7eaf267f938 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:44.689874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d7d2-1bf3-414c-8262-b7eaf267f938 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:44.691245 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 629/1274] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:44.696357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32038897-dca6-41ca-9cd6-482e7ff42c4c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:44.696802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32038897-dca6-41ca-9cd6-482e7ff42c4c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:44.696912 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32038897-dca6-41ca-9cd6-482e7ff42c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:44.715226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-32038897-dca6-41ca-9cd6-482e7ff42c4c None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:44.716630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-32038897-dca6-41ca-9cd6-482e7ff42c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:44.781437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 646/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:15:45.051467 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06d7d2-1bf3-414c-8262-b7eaf267f938 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:45.151153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06d7d2-1bf3-414c-8262-b7eaf267f938 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:45.169886 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:45.189226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8573119-a5cf-427c-ab6d-7fb5a26b6727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:45.189852 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8573119-a5cf-427c-ab6d-7fb5a26b6727 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:45.190162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8573119-a5cf-427c-ab6d-7fb5a26b6727 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:45.190438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8573119-a5cf-427c-ab6d-7fb5a26b6727 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:45.200322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8573119-a5cf-427c-ab6d-7fb5a26b6727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 16:15:45.205704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-f8573119-a5cf-427c-ab6d-7fb5a26b6727 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:45.205704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:45.205704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:45.205704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:45.205704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:45.205704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:45.205704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:45.205704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:45.205704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:45.205704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:45.205704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:45.205704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:45.205704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 16:15:45.205704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 16:15:45.205704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 16:15:45.205704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 16:15:45.206891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 16:15:45.206891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 16:15:45.206891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 16:15:45.206891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 16:15:45.206891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:45.206891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:45.206891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:45.206891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:45.206891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:45.206891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:45.206891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:45.206891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:45.206891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:45.206891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:45.206891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:45.206891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:45.207714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:45.207714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:45.207714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:45.207714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:45.207714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 16:15:45.207714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 16:15:45.207714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 16:15:45.207714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 16:15:45.207714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 16:15:45.207714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 16:15:45.207714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 16:15:45.207714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:45.207714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 630/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 16:15:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:45.212846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32038897-dca6-41ca-9cd6-482e7ff42c4c None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:45.291701 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:45.310470 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32038897-dca6-41ca-9cd6-482e7ff42c4c None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:45.344667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188935a-15c6-41ec-8f73-eb3a0cae4e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:45.345263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188935a-15c6-41ec-8f73-eb3a0cae4e19 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:45.345543 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188935a-15c6-41ec-8f73-eb3a0cae4e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:45.345817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188935a-15c6-41ec-8f73-eb3a0cae4e19 None admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:45.346509 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188935a-15c6-41ec-8f73-eb3a0cae4e19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:45.346815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188935a-15c6-41ec-8f73-eb3a0cae4e19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:45.348174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188935a-15c6-41ec-8f73-eb3a0cae4e19 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:45.355923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 647/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 16:15:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:45.361617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8573119-a5cf-427c-ab6d-7fb5a26b6727 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:45.460269 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8573119-a5cf-427c-ab6d-7fb5a26b6727 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:45.492874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52bc2d-a827-4fed-b096-bff46a833e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:45.493495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52bc2d-a827-4fed-b096-bff46a833e54 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:45.493775 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52bc2d-a827-4fed-b096-bff46a833e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:45.494046 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52bc2d-a827-4fed-b096-bff46a833e54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:45.503865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52bc2d-a827-4fed-b096-bff46a833e54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:45.505289 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52bc2d-a827-4fed-b096-bff46a833e54 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:45.519865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-1b52bc2d-a827-4fed-b096-bff46a833e54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:45.519865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:45.519865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:45.519865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:45.519865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:45.519865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:45.519865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:45.519865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:45.519865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:45.519865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:45.519865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:45.519865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:45.519865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:15:45.519865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:15:45.519865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:15:45.519865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:15:45.520951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:45.520951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:45.520951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:45.520951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:45.520951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:45.520951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:45.520951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:45.520951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:45.520951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:45.520951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:45.520951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:45.520951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:45.520951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:45.520951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:45.520951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:45.520951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:45.520951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:15:45.522169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:15:45.522169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:45.522169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:45.522169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 631/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:45.526751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188935a-15c6-41ec-8f73-eb3a0cae4e19 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:45.646733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188935a-15c6-41ec-8f73-eb3a0cae4e19 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:45.680368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077f942-102c-4663-af64-3bac3c845886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:45.680959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077f942-102c-4663-af64-3bac3c845886 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:45.681246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077f942-102c-4663-af64-3bac3c845886 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:45.681516 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077f942-102c-4663-af64-3bac3c845886 None admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:45.682177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077f942-102c-4663-af64-3bac3c845886 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:45.682481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077f942-102c-4663-af64-3bac3c845886 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:45.683840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077f942-102c-4663-af64-3bac3c845886 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:45.695567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 648/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:45.701237 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52bc2d-a827-4fed-b096-bff46a833e54 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:45.731690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:45.799159 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52bc2d-a827-4fed-b096-bff46a833e54 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:45.833813 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fa6e5-9ad7-42ec-910b-e0524a380e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:45.834466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fa6e5-9ad7-42ec-910b-e0524a380e52 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:45.834748 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fa6e5-9ad7-42ec-910b-e0524a380e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:45.835021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fa6e5-9ad7-42ec-910b-e0524a380e52 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:45.843153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fa6e5-9ad7-42ec-910b-e0524a380e52 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:45.844564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fa6e5-9ad7-42ec-910b-e0524a380e52 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:45.855703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-d69fa6e5-9ad7-42ec-910b-e0524a380e52 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:15:45.855703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:45.855703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:45.855703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:45.855703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:45.855703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:45.855703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:45.855703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:45.855703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:45.855703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:45.855703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:45.855703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:45.855703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 16:15:45.855703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 16:15:45.855703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 16:15:45.855703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 16:15:45.856633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:45.856633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:45.856633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 16:15:45.856633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:15:45.856633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 16:15:45.856633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 16:15:45.856633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:45.856633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:45.856633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:45.856633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:45.856633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:45.856633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:45.856633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:45.856633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:45.856633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:45.856633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:45.856633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:45.856633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:45.862653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:45.862653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:45.862653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 16:15:45.862653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 16:15:45.862653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 16:15:45.862653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 16:15:45.862653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 16:15:45.862653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 16:15:45.862653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 16:15:45.862653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:45.862653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 632/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:45.863352 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077f942-102c-4663-af64-3bac3c845886 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:45.867306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:45.966789 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077f942-102c-4663-af64-3bac3c845886 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:46.002238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a417581-9a9d-45fd-b430-2330936424ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:46.002840 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a417581-9a9d-45fd-b430-2330936424ec None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:46.003121 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a417581-9a9d-45fd-b430-2330936424ec None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:46.003391 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a417581-9a9d-45fd-b430-2330936424ec None admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:46.004107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a417581-9a9d-45fd-b430-2330936424ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:46.004407 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a417581-9a9d-45fd-b430-2330936424ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:46.005825 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a417581-9a9d-45fd-b430-2330936424ec None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:46.024432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 649/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 23 16:15:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:46.030511 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fa6e5-9ad7-42ec-910b-e0524a380e52 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:46.120801 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:46.131195 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fa6e5-9ad7-42ec-910b-e0524a380e52 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:46.164325 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748279d-c60b-4da2-adeb-d54f2b9ac7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:46.164931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748279d-c60b-4da2-adeb-d54f2b9ac7ea None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:46.165213 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748279d-c60b-4da2-adeb-d54f2b9ac7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:46.165490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748279d-c60b-4da2-adeb-d54f2b9ac7ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:46.230673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748279d-c60b-4da2-adeb-d54f2b9ac7ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:46.232049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748279d-c60b-4da2-adeb-d54f2b9ac7ea None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:46.317092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:46.327023 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 633/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 16:15:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 16:15:46.333065 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a417581-9a9d-45fd-b430-2330936424ec None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:46.392970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:46.431613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a417581-9a9d-45fd-b430-2330936424ec None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:46.465780 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c644b5-7904-4aa1-8ce8-569515b0b096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:46.466420 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c644b5-7904-4aa1-8ce8-569515b0b096 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:46.466698 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c644b5-7904-4aa1-8ce8-569515b0b096 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:46.466965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c644b5-7904-4aa1-8ce8-569515b0b096 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:46.477392 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c644b5-7904-4aa1-8ce8-569515b0b096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:46.478843 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c644b5-7904-4aa1-8ce8-569515b0b096 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:46.493674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-94c644b5-7904-4aa1-8ce8-569515b0b096 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:46.493674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:46.493674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:46.493674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:46.493674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:46.493674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:46.493674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:46.493674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:46.493674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:46.493674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:46.493674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:46.493674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:46.493674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 16:15:46.493674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 16:15:46.493674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 16:15:46.493674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 16:15:46.494827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:46.494827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:46.494827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:46.494827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:46.494827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:46.494827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:46.494827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:46.494827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:46.494827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:46.494827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:46.494827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:46.494827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:46.494827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:46.494827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:46.494827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:46.494827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:46.494827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 16:15:46.495752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 16:15:46.495752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 16:15:46.495752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:15:46.495752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 650/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:46.501148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748279d-c60b-4da2-adeb-d54f2b9ac7ea None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:46.601297 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748279d-c60b-4da2-adeb-d54f2b9ac7ea None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:46.635035 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e214a-18ed-411c-950f-004a98cbe7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:46.635630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e214a-18ed-411c-950f-004a98cbe7bd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:46.635910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e214a-18ed-411c-950f-004a98cbe7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:46.636181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e214a-18ed-411c-950f-004a98cbe7bd None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:46.636813 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e214a-18ed-411c-950f-004a98cbe7bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:46.637115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e214a-18ed-411c-950f-004a98cbe7bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:46.638489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e214a-18ed-411c-950f-004a98cbe7bd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:46.649353 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 634/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 16:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:46.656186 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c644b5-7904-4aa1-8ce8-569515b0b096 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:46.754974 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c644b5-7904-4aa1-8ce8-569515b0b096 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:46.768291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:46.789288 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb8a67-f9cb-48c7-b955-22e8e6ae7364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:46.789903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb8a67-f9cb-48c7-b955-22e8e6ae7364 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:46.790233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb8a67-f9cb-48c7-b955-22e8e6ae7364 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:46.790491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb8a67-f9cb-48c7-b955-22e8e6ae7364 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:46.798367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb8a67-f9cb-48c7-b955-22e8e6ae7364 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:46.800202 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb8a67-f9cb-48c7-b955-22e8e6ae7364 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:46.810931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application [None req-14bb8a67-f9cb-48c7-b955-22e8e6ae7364 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:15:46.810931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:46.810931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:46.810931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:46.810931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:46.810931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:46.810931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:46.810931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:46.810931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:46.810931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:46.810931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:46.810931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:46.810931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 16:15:46.810931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 16:15:46.810931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 16:15:46.811942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 16:15:46.811942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:46.811942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:46.811942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:46.811942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:46.811942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:46.811942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:46.811942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:46.811942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:46.811942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:46.811942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:46.811942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:46.811942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:46.811942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:46.811942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:46.811942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:46.811942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:46.813055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 16:15:46.813055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 16:15:46.813055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 16:15:46.813055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 16:15:46.813055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 16:15:46.813055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 16:15:46.813055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 16:15:46.813055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: ERROR keystone.server.flask.application Aug 23 16:15:46.813055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 651/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 16:15:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:46.818395 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e214a-18ed-411c-950f-004a98cbe7bd None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:46.866983 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:46.914560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e214a-18ed-411c-950f-004a98cbe7bd None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:46.946740 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6124e-0b8d-401e-88ef-2e8ae37256bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:46.947331 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6124e-0b8d-401e-88ef-2e8ae37256bc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:46.947606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6124e-0b8d-401e-88ef-2e8ae37256bc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:46.947875 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6124e-0b8d-401e-88ef-2e8ae37256bc None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:46.948549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6124e-0b8d-401e-88ef-2e8ae37256bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:46.948851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6124e-0b8d-401e-88ef-2e8ae37256bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:46.950285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6124e-0b8d-401e-88ef-2e8ae37256bc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:46.962197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 635/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 16:15:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:46.969066 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb8a67-f9cb-48c7-b955-22e8e6ae7364 None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:47.069038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb8a67-f9cb-48c7-b955-22e8e6ae7364 None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:47.105000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18019c9-fc62-4ae9-8471-54362ed4eee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:47.105598 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18019c9-fc62-4ae9-8471-54362ed4eee1 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:47.105879 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18019c9-fc62-4ae9-8471-54362ed4eee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:47.106243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18019c9-fc62-4ae9-8471-54362ed4eee1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:47.106968 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18019c9-fc62-4ae9-8471-54362ed4eee1 None admin] RBAC: Adding query filter params (role.id=8de0c87242d7426ea25a510b578c02aa, scope.project.id=15a0439c9dd3406f81e2740fe775782b, user.id=9cd1309c315e49eea6af4691d14c3e90) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:47.107278 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18019c9-fc62-4ae9-8471-54362ed4eee1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:47.108987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18019c9-fc62-4ae9-8471-54362ed4eee1 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:47.114622 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 652/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 16:15:46 2022] GET /identity/v3/role_assignments?user.id=9cd1309c315e49eea6af4691d14c3e90&scope.project.id=15a0439c9dd3406f81e2740fe775782b&role.id=8de0c87242d7426ea25a510b578c02aa => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:15:49.237286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ed0ca-4dbd-4ac1-9ead-406389915f51 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:49.237794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ed0ca-4dbd-4ac1-9ead-406389915f51 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:49.237885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ed0ca-4dbd-4ac1-9ead-406389915f51 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:49.239207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 636/1288] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:49.244266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f9128-ae90-4a80-963b-3c1fc9a957af None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:49.244670 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f9128-ae90-4a80-963b-3c1fc9a957af None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:49.244818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f9128-ae90-4a80-963b-3c1fc9a957af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:49.263222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-b03f9128-ae90-4a80-963b-3c1fc9a957af None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:49.264625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b03f9128-ae90-4a80-963b-3c1fc9a957af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:49.293285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:49.335844 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 653/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:15:49.607126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ed0ca-4dbd-4ac1-9ead-406389915f51 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:49.713247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ed0ca-4dbd-4ac1-9ead-406389915f51 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:49.724081 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:49.746677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874569f-fbf5-4311-b8bd-be5bbc792c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:49.747291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874569f-fbf5-4311-b8bd-be5bbc792c89 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:49.747568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874569f-fbf5-4311-b8bd-be5bbc792c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:49.747836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874569f-fbf5-4311-b8bd-be5bbc792c89 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:49.748436 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874569f-fbf5-4311-b8bd-be5bbc792c89 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:49.749780 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874569f-fbf5-4311-b8bd-be5bbc792c89 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:49.758034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-f874569f-fbf5-4311-b8bd-be5bbc792c89 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:15:49.758034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:49.758034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:15:49.758034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:15:49.758034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:15:49.758034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:15:49.758034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:15:49.758034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:15:49.758034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:15:49.758034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:49.758034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:15:49.758034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:49.758034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:49.758034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:49.758034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:49.758034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:49.758034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:49.759275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:49.759275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:49.759275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:49.759275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:49.759275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:49.759275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:49.759275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:15:49.759275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:15:49.759275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:15:49.759275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:15:49.759275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:49.759275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:49.759275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:49.759275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:49.759275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:49.759275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:49.760504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:49.760504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:49.760504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:49.760504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:49.760504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:49.760504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:49.760504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:49.760504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:49.760504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:49.760504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:49.760504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:15:49.760504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:15:49.760504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:15:49.760504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:49.760504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 637/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 23 16:15:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:49.765170 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f9128-ae90-4a80-963b-3c1fc9a957af None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:49.863434 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f9128-ae90-4a80-963b-3c1fc9a957af None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:49.896355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f70f9a-d02c-42b5-916b-4c17f12c713c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:49.896944 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f70f9a-d02c-42b5-916b-4c17f12c713c None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:49.897219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f70f9a-d02c-42b5-916b-4c17f12c713c None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:49.897486 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f70f9a-d02c-42b5-916b-4c17f12c713c None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:49.898123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f70f9a-d02c-42b5-916b-4c17f12c713c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:49.898423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f70f9a-d02c-42b5-916b-4c17f12c713c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:49.899775 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f70f9a-d02c-42b5-916b-4c17f12c713c None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:49.905177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 654/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Aug 23 16:15:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:49.910947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874569f-fbf5-4311-b8bd-be5bbc792c89 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:50.007319 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874569f-fbf5-4311-b8bd-be5bbc792c89 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:50.038966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b8eb4-49be-43e7-9906-a66637895853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:50.039549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b8eb4-49be-43e7-9906-a66637895853 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:50.039825 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b8eb4-49be-43e7-9906-a66637895853 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:50.040095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b8eb4-49be-43e7-9906-a66637895853 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:50.040713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b8eb4-49be-43e7-9906-a66637895853 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:50.041012 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b8eb4-49be-43e7-9906-a66637895853 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:50.042380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b8eb4-49be-43e7-9906-a66637895853 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:50.047163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 638/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Aug 23 16:15:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:51.966987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15d984-5e1b-4fcd-8c43-94491e76feeb None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:51.967520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15d984-5e1b-4fcd-8c43-94491e76feeb None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:51.967682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15d984-5e1b-4fcd-8c43-94491e76feeb None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:51.969016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 655/1293] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:51.974265 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fffd55-40a1-493c-b88d-8d33c38a02db None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:51.974682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fffd55-40a1-493c-b88d-8d33c38a02db None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:51.974821 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fffd55-40a1-493c-b88d-8d33c38a02db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:51.992527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-89fffd55-40a1-493c-b88d-8d33c38a02db None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:51.993708 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-89fffd55-40a1-493c-b88d-8d33c38a02db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:52.023745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:52.059460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 639/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:15:52.331875 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15d984-5e1b-4fcd-8c43-94491e76feeb None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:52.363584 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:52.437777 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15d984-5e1b-4fcd-8c43-94491e76feeb None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:52.475128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453eea0-0c7b-4a7c-bbea-7149070b8f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:52.475724 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453eea0-0c7b-4a7c-bbea-7149070b8f01 None admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:52.476007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453eea0-0c7b-4a7c-bbea-7149070b8f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:52.476277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453eea0-0c7b-4a7c-bbea-7149070b8f01 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:52.476910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453eea0-0c7b-4a7c-bbea-7149070b8f01 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:52.478308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453eea0-0c7b-4a7c-bbea-7149070b8f01 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:52.492738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 656/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 16:15:52 2022] POST /identity/v3/services => generated 246 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:15:54.408071 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234d00f-3836-4dc8-95f2-cf75b2870b46 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:54.408629 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234d00f-3836-4dc8-95f2-cf75b2870b46 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:54.408629 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234d00f-3836-4dc8-95f2-cf75b2870b46 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:54.409960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 640/1296] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:54.415268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de109d92-af1c-4f96-844c-bda9271fc1e6 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:54.415644 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de109d92-af1c-4f96-844c-bda9271fc1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:54.415830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de109d92-af1c-4f96-844c-bda9271fc1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:54.434456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-de109d92-af1c-4f96-844c-bda9271fc1e6 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:54.435651 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-de109d92-af1c-4f96-844c-bda9271fc1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:54.507520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 657/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:54 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:15:54.777050 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234d00f-3836-4dc8-95f2-cf75b2870b46 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:54.876260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234d00f-3836-4dc8-95f2-cf75b2870b46 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:54.909136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd5f32-f4ab-4483-b5d2-51dd20cc93eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:54.909762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd5f32-f4ab-4483-b5d2-51dd20cc93eb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:54.910032 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd5f32-f4ab-4483-b5d2-51dd20cc93eb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:54.910334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd5f32-f4ab-4483-b5d2-51dd20cc93eb None admin] PATH_INFO: `/v3/services/placement` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:54.910913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd5f32-f4ab-4483-b5d2-51dd20cc93eb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:54.912260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd5f32-f4ab-4483-b5d2-51dd20cc93eb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:54.920964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-0cdd5f32-f4ab-4483-b5d2-51dd20cc93eb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:15:54.920964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:54.920964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:15:54.920964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:15:54.920964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:15:54.920964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:15:54.920964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:15:54.920964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:15:54.920964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:15:54.920964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:54.920964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:15:54.920964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:54.920964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:54.920964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:54.920964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:54.920964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:54.920964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:54.922224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:54.922224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:54.922224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:54.922224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:54.922224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:54.922224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:54.922224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:15:54.922224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:15:54.922224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:15:54.922224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:15:54.922224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:54.922224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:54.922224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:54.922224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:54.922224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:54.922224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:54.923244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:54.923244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:54.923244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:54.923244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:54.923244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:54.923244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:54.923244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:54.923244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:54.923244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:54.923244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:54.923244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:15:54.923244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:15:54.923244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:15:54.923244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:54.923244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 641/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 23 16:15:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 16:15:54.928043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de109d92-af1c-4f96-844c-bda9271fc1e6 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:54.946658 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:55.026410 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de109d92-af1c-4f96-844c-bda9271fc1e6 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:55.059109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfab95a-af50-45a0-890d-c03d397daaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:55.059701 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab95a-af50-45a0-890d-c03d397daaca None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:55.059981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab95a-af50-45a0-890d-c03d397daaca None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:55.060252 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab95a-af50-45a0-890d-c03d397daaca None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:55.061610 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfab95a-af50-45a0-890d-c03d397daaca None admin] RBAC: Adding query filter params (name=placement) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:55.061914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfab95a-af50-45a0-890d-c03d397daaca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:55.063313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfab95a-af50-45a0-890d-c03d397daaca None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:55.068360 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 658/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Aug 23 16:15:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:55.074328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd5f32-f4ab-4483-b5d2-51dd20cc93eb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:55.106343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:55.174557 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd5f32-f4ab-4483-b5d2-51dd20cc93eb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:55.207655 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9f35d-b0b9-4ef4-b4e1-1a5f95766ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:55.208255 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9f35d-b0b9-4ef4-b4e1-1a5f95766ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:55.208532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9f35d-b0b9-4ef4-b4e1-1a5f95766ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:55.208803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9f35d-b0b9-4ef4-b4e1-1a5f95766ff3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:55.209496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9f35d-b0b9-4ef4-b4e1-1a5f95766ff3 None admin] RBAC: Adding query filter params (interface=public, service_id=718ce86ebd9a433ead3ed707d353a23f, region_id=RegionOne) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:55.209804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9f35d-b0b9-4ef4-b4e1-1a5f95766ff3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:55.211181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9f35d-b0b9-4ef4-b4e1-1a5f95766ff3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:55.215944 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 642/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 23 16:15:55 2022] GET /identity/v3/endpoints?service_id=718ce86ebd9a433ead3ed707d353a23f&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:55.221604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfab95a-af50-45a0-890d-c03d397daaca None admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:55.302002 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:55.320819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfab95a-af50-45a0-890d-c03d397daaca None admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:55.353258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc5bfe-f204-4ebc-b66c-caf7aeb91f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:55.353858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc5bfe-f204-4ebc-b66c-caf7aeb91f81 None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:55.354166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc5bfe-f204-4ebc-b66c-caf7aeb91f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:55.354441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc5bfe-f204-4ebc-b66c-caf7aeb91f81 None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:55.355042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc5bfe-f204-4ebc-b66c-caf7aeb91f81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:55.356404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc5bfe-f204-4ebc-b66c-caf7aeb91f81 None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:55.363568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 659/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 23 16:15:55 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:15:57.251253 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bb9ad-427b-4252-b099-55edfdbefce9 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:57.251774 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bb9ad-427b-4252-b099-55edfdbefce9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:57.251883 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bb9ad-427b-4252-b099-55edfdbefce9 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:57.253161 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 643/1302] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:15:57.258216 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7aa41-12f2-4f10-99b6-97abfef3cbc7 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:57.258609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7aa41-12f2-4f10-99b6-97abfef3cbc7 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:57.258764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7aa41-12f2-4f10-99b6-97abfef3cbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:57.276288 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-3ef7aa41-12f2-4f10-99b6-97abfef3cbc7 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:15:57.277456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-3ef7aa41-12f2-4f10-99b6-97abfef3cbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:15:57.343184 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 660/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:15:57 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 16:15:57.612361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bb9ad-427b-4252-b099-55edfdbefce9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:57.706970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:57.713737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bb9ad-427b-4252-b099-55edfdbefce9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:57.745711 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d6e7f-06e8-4058-abcf-31d98157bd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:57.746357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d6e7f-06e8-4058-abcf-31d98157bd26 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:57.746636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d6e7f-06e8-4058-abcf-31d98157bd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:57.746909 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d6e7f-06e8-4058-abcf-31d98157bd26 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:57.747487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d6e7f-06e8-4058-abcf-31d98157bd26 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:57.749415 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d6e7f-06e8-4058-abcf-31d98157bd26 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:57.757734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-ee0d6e7f-06e8-4058-abcf-31d98157bd26 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:15:57.757734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:57.757734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 16:15:57.757734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 16:15:57.757734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 16:15:57.757734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 16:15:57.757734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 16:15:57.757734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:15:57.757734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:15:57.757734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:57.757734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 16:15:57.757734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:57.757734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 16:15:57.757734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 16:15:57.757734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 16:15:57.757734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 16:15:57.757734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 16:15:57.758888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 16:15:57.758888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 16:15:57.758888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 16:15:57.758888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 16:15:57.758888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 16:15:57.758888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 16:15:57.758888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 16:15:57.758888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 16:15:57.758888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 16:15:57.758888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 16:15:57.758888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 16:15:57.758888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 16:15:57.758888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 16:15:57.758888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 16:15:57.758888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 16:15:57.758888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 16:15:57.759863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 16:15:57.759863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 23 16:15:57.759863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 16:15:57.759863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 23 16:15:57.759863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 16:15:57.759863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 16:15:57.759863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 16:15:57.759863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 23 16:15:57.759863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 16:15:57.759863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 23 16:15:57.759863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 16:15:57.759863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 16:15:57.759863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 16:15:57.759863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 23 16:15:57.759863 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 644/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 23 16:15:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 16:15:57.765171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7aa41-12f2-4f10-99b6-97abfef3cbc7 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:57.840049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:15:57.863736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7aa41-12f2-4f10-99b6-97abfef3cbc7 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:57.897491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f61e9f-368e-4c8e-aebb-5c06d22b45ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:57.898107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f61e9f-368e-4c8e-aebb-5c06d22b45ff None admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:57.898390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f61e9f-368e-4c8e-aebb-5c06d22b45ff None admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:57.898665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f61e9f-368e-4c8e-aebb-5c06d22b45ff None admin] PATH_INFO: `/v3/services` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:57.899293 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f61e9f-368e-4c8e-aebb-5c06d22b45ff None admin] RBAC: Adding query filter params (name=placement) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:15:57.899599 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f61e9f-368e-4c8e-aebb-5c06d22b45ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:57.900960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f61e9f-368e-4c8e-aebb-5c06d22b45ff None admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:57.906735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 661/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Aug 23 16:15:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:15:57.912663 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d6e7f-06e8-4058-abcf-31d98157bd26 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:15:58.009384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d6e7f-06e8-4058-abcf-31d98157bd26 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:15:58.042118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccce071-1368-4970-baff-17c318b7d86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:15:58.042718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccce071-1368-4970-baff-17c318b7d86d None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:15:58.042996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccce071-1368-4970-baff-17c318b7d86d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:15:58.043266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccce071-1368-4970-baff-17c318b7d86d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:15:58.043913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccce071-1368-4970-baff-17c318b7d86d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:15:58.045570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccce071-1368-4970-baff-17c318b7d86d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:15:58.065108 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 645/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 16:15:57 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:16:07.903985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=30 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:16:08.060172 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:02.286728 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6a40f-07c6-4a3d-b209-910fa1e011af None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:02.287326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6a40f-07c6-4a3d-b209-910fa1e011af None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:02.287326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6a40f-07c6-4a3d-b209-910fa1e011af None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:02.292897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 662/1307] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:17:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:02.294108 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d1a20-882c-4a29-b639-c9c538259b8f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:02.294537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d1a20-882c-4a29-b639-c9c538259b8f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:02.294647 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d1a20-882c-4a29-b639-c9c538259b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:02.417333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-485d1a20-882c-4a29-b639-c9c538259b8f None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:02.418955 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-485d1a20-882c-4a29-b639-c9c538259b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:02.575738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 646/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:17:02.871743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e295ea-3dc0-4c0e-a6d6-533b01475c43 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:02.872183 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e295ea-3dc0-4c0e-a6d6-533b01475c43 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:02.872561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e295ea-3dc0-4c0e-a6d6-533b01475c43 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:02.874198 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 663/1309] 10.222.0.16 () {54 vars in 965 bytes} [Tue Aug 23 16:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:02.880338 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2039e-bb03-417e-bcc8-fc1b0463c6bb None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:02.881265 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2039e-bb03-417e-bcc8-fc1b0463c6bb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:02.881548 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2039e-bb03-417e-bcc8-fc1b0463c6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:02.965361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d2b2039e-bb03-417e-bcc8-fc1b0463c6bb None None] MFA Rules not processed for user `9eae00506f75402fbf972a8991ad0a68`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:02.966600 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d2b2039e-bb03-417e-bcc8-fc1b0463c6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:02.988409 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:03.050646 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 647/1310] 10.222.0.16 () {58 vars in 1062 bytes} [Tue Aug 23 16:17:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:03.061170 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e295ea-3dc0-4c0e-a6d6-533b01475c43 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:03.062926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-10e295ea-3dc0-4c0e-a6d6-533b01475c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:03.184968 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e295ea-3dc0-4c0e-a6d6-533b01475c43 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:03.264507 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed50e6-2d6b-48a5-9647-81b37295b34a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:03.265121 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed50e6-2d6b-48a5-9647-81b37295b34a service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:03.265399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed50e6-2d6b-48a5-9647-81b37295b34a service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:03.265669 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed50e6-2d6b-48a5-9647-81b37295b34a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:03.267284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-85ed50e6-2d6b-48a5-9647-81b37295b34a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:03.330558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:03.394728 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed50e6-2d6b-48a5-9647-81b37295b34a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:03.396193 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed50e6-2d6b-48a5-9647-81b37295b34a service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:03.418660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 664/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:17:05.677166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9ab32-a592-44e7-b10d-e37569afc80a None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:05.677740 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9ab32-a592-44e7-b10d-e37569afc80a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:05.677964 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9ab32-a592-44e7-b10d-e37569afc80a None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:05.679713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 648/1312] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:05.686384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca047615-1404-424b-9298-eddcfcc10343 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:05.686902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca047615-1404-424b-9298-eddcfcc10343 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:05.687010 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca047615-1404-424b-9298-eddcfcc10343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:05.766851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-ca047615-1404-424b-9298-eddcfcc10343 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:05.768096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ca047615-1404-424b-9298-eddcfcc10343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:05.879299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 665/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:06.164593 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9ab32-a592-44e7-b10d-e37569afc80a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:06.166183 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e8f9ab32-a592-44e7-b10d-e37569afc80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:06.267922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9ab32-a592-44e7-b10d-e37569afc80a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:06.337659 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:06.340177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03b334-0735-4d9f-af67-664776e846e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:06.340949 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03b334-0735-4d9f-af67-664776e846e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:06.341287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03b334-0735-4d9f-af67-664776e846e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:06.341734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03b334-0735-4d9f-af67-664776e846e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:06.343564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7f03b334-0735-4d9f-af67-664776e846e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:06.450413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03b334-0735-4d9f-af67-664776e846e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:06.451749 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03b334-0735-4d9f-af67-664776e846e9 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:06.469476 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 649/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:17:08.690484 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956cfc3-bd0d-41dc-9fdf-278f185dc30a None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:08.691048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956cfc3-bd0d-41dc-9fdf-278f185dc30a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:08.691048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956cfc3-bd0d-41dc-9fdf-278f185dc30a None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:08.692446 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 666/1315] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:08.698270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126104e-8b1d-46f4-9f14-71b8eab31473 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:08.698687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126104e-8b1d-46f4-9f14-71b8eab31473 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:08.698846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126104e-8b1d-46f4-9f14-71b8eab31473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:08.763096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7126104e-8b1d-46f4-9f14-71b8eab31473 None None] MFA Rules not processed for user `c194e717ca3a4063b26b04df33afe67b`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:08.764301 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7126104e-8b1d-46f4-9f14-71b8eab31473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:08.814845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:08.859953 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 650/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:09.154108 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956cfc3-bd0d-41dc-9fdf-278f185dc30a None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:09.155652 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c956cfc3-bd0d-41dc-9fdf-278f185dc30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:09.166432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:09.265337 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956cfc3-bd0d-41dc-9fdf-278f185dc30a None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:09.337998 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c5d91-4b70-48f9-9585-b60a5373c9ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:09.338618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c5d91-4b70-48f9-9585-b60a5373c9ce service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:09.338900 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c5d91-4b70-48f9-9585-b60a5373c9ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:09.339172 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c5d91-4b70-48f9-9585-b60a5373c9ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:09.340765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f35c5d91-4b70-48f9-9585-b60a5373c9ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:09.402251 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:09.450072 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c5d91-4b70-48f9-9585-b60a5373c9ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:09.451521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c5d91-4b70-48f9-9585-b60a5373c9ce service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:09.469522 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 667/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:17:09 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:17:11.974291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d6efb-8722-495e-922a-0d9e94d1a758 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:11.974881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d6efb-8722-495e-922a-0d9e94d1a758 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:11.974881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d6efb-8722-495e-922a-0d9e94d1a758 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:11.976167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 651/1318] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:11.981486 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165c97e-db29-4808-ba36-7b42da9e5fe0 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:11.981881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165c97e-db29-4808-ba36-7b42da9e5fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:11.982033 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165c97e-db29-4808-ba36-7b42da9e5fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:12.047835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-1165c97e-db29-4808-ba36-7b42da9e5fe0 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:12.049043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1165c97e-db29-4808-ba36-7b42da9e5fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:12.145677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 668/1319] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:12.449114 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a078c-0402-4796-9fe0-88486164c5a0 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:12.449398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a078c-0402-4796-9fe0-88486164c5a0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:12.449673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a078c-0402-4796-9fe0-88486164c5a0 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:12.451082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 652/1320] 10.222.0.16 () {54 vars in 965 bytes} [Tue Aug 23 16:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:12.456858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb0c5a-5a97-4a1b-a25d-d241667e9e86 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:12.457143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb0c5a-5a97-4a1b-a25d-d241667e9e86 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:12.457418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb0c5a-5a97-4a1b-a25d-d241667e9e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:12.479889 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:12.535490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-87cb0c5a-5a97-4a1b-a25d-d241667e9e86 None None] MFA Rules not processed for user `9eae00506f75402fbf972a8991ad0a68`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:12.536695 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-87cb0c5a-5a97-4a1b-a25d-d241667e9e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:12.612580 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 669/1321] 10.222.0.16 () {58 vars in 1062 bytes} [Tue Aug 23 16:17:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:12.622007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a078c-0402-4796-9fe0-88486164c5a0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:12.623566 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1f7a078c-0402-4796-9fe0-88486164c5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:12.725502 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a078c-0402-4796-9fe0-88486164c5a0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:12.798555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06ef18-4a76-479f-aa18-0c7fa03e875a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:12.799164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06ef18-4a76-479f-aa18-0c7fa03e875a service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:12.799444 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06ef18-4a76-479f-aa18-0c7fa03e875a service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:12.799715 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06ef18-4a76-479f-aa18-0c7fa03e875a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:12.801335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9e06ef18-4a76-479f-aa18-0c7fa03e875a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:12.809004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:12.909770 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06ef18-4a76-479f-aa18-0c7fa03e875a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:12.911233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06ef18-4a76-479f-aa18-0c7fa03e875a service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:12.930463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 653/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:17:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:17:15.963909 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f5dcb-6b9e-4713-8007-735984abc953 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:15.964449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f5dcb-6b9e-4713-8007-735984abc953 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:15.964449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f5dcb-6b9e-4713-8007-735984abc953 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:15.965808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 670/1323] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:15.971188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e432a77-b94d-4562-b0c3-3fe3fabd7d8d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:15.971610 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e432a77-b94d-4562-b0c3-3fe3fabd7d8d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:15.971792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e432a77-b94d-4562-b0c3-3fe3fabd7d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:16.038371 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8e432a77-b94d-4562-b0c3-3fe3fabd7d8d None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:16.040221 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8e432a77-b94d-4562-b0c3-3fe3fabd7d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:16.097986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:16.137806 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 654/1324] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:16.424313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f5dcb-6b9e-4713-8007-735984abc953 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:16.425850 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-3d9f5dcb-6b9e-4713-8007-735984abc953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:16.530640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f5dcb-6b9e-4713-8007-735984abc953 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:16.544824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:16.608672 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22f144-3272-44e8-ae9c-531dd7650de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:16.609168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22f144-3272-44e8-ae9c-531dd7650de1 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:16.609445 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22f144-3272-44e8-ae9c-531dd7650de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:16.609715 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22f144-3272-44e8-ae9c-531dd7650de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:16.611685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5d22f144-3272-44e8-ae9c-531dd7650de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:16.724490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22f144-3272-44e8-ae9c-531dd7650de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:16.726513 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22f144-3272-44e8-ae9c-531dd7650de1 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:16.744932 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 671/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:17:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:17:18.721885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766596e-489f-4070-b934-980b66beb98d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:18.722421 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766596e-489f-4070-b934-980b66beb98d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:18.722421 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766596e-489f-4070-b934-980b66beb98d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:18.723749 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 655/1326] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:18.729242 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9977a-ff96-491f-b28c-627f2fb57893 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:18.729661 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9977a-ff96-491f-b28c-627f2fb57893 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:18.729811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9977a-ff96-491f-b28c-627f2fb57893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:18.780304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:18.798780 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-b4b9977a-ff96-491f-b28c-627f2fb57893 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:18.799988 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b4b9977a-ff96-491f-b28c-627f2fb57893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:18.896837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 672/1327] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:19.186262 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766596e-489f-4070-b934-980b66beb98d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:19.187869 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d766596e-489f-4070-b934-980b66beb98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:19.302812 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766596e-489f-4070-b934-980b66beb98d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:19.376174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f53bd-f3a1-4a0e-a5c8-621133e1f472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:19.376785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f53bd-f3a1-4a0e-a5c8-621133e1f472 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:19.377068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f53bd-f3a1-4a0e-a5c8-621133e1f472 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:19.377342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f53bd-f3a1-4a0e-a5c8-621133e1f472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:19.378967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-273f53bd-f3a1-4a0e-a5c8-621133e1f472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:19.396221 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:19.489684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f53bd-f3a1-4a0e-a5c8-621133e1f472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:19.491546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f53bd-f3a1-4a0e-a5c8-621133e1f472 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:19.509465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 656/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:17:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:17:21.472659 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeea036-a488-431d-ab38-0e0257944164 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:21.473196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeea036-a488-431d-ab38-0e0257944164 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:21.473373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeea036-a488-431d-ab38-0e0257944164 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:21.474879 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 673/1329] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:21.480427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a486c0b-1df2-4cd1-8c52-0679c71b20fd None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:21.480913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a486c0b-1df2-4cd1-8c52-0679c71b20fd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:21.481024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a486c0b-1df2-4cd1-8c52-0679c71b20fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:21.554506 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5a486c0b-1df2-4cd1-8c52-0679c71b20fd None None] MFA Rules not processed for user `c194e717ca3a4063b26b04df33afe67b`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:21.555714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5a486c0b-1df2-4cd1-8c52-0679c71b20fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:21.623034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:21.656606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 657/1330] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:21 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:21.942183 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeea036-a488-431d-ab38-0e0257944164 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:21.943726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-adeea036-a488-431d-ab38-0e0257944164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:22.053058 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeea036-a488-431d-ab38-0e0257944164 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:22.073838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:22.128828 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cc541-b9a6-47e5-8025-2e4a250ae68d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:22.129367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc541-b9a6-47e5-8025-2e4a250ae68d service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:22.129643 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc541-b9a6-47e5-8025-2e4a250ae68d service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:22.129913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc541-b9a6-47e5-8025-2e4a250ae68d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:22.131626 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-048cc541-b9a6-47e5-8025-2e4a250ae68d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:22.249829 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cc541-b9a6-47e5-8025-2e4a250ae68d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:22.251329 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cc541-b9a6-47e5-8025-2e4a250ae68d service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:22.271665 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 674/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:17:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:17:24.477729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eefcba-ba49-463f-b75d-96e8aa7d7a32 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:24.478266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eefcba-ba49-463f-b75d-96e8aa7d7a32 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:24.478266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eefcba-ba49-463f-b75d-96e8aa7d7a32 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:24.479567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 658/1332] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:24.484763 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3565ad-1a9b-4832-9b2d-2165612a8961 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:24.485189 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3565ad-1a9b-4832-9b2d-2165612a8961 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:24.485339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3565ad-1a9b-4832-9b2d-2165612a8961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:24.551109 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:24.554985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-7d3565ad-1a9b-4832-9b2d-2165612a8961 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:24.556824 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7d3565ad-1a9b-4832-9b2d-2165612a8961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:24.653985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 675/1333] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:24.940233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eefcba-ba49-463f-b75d-96e8aa7d7a32 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:24.941804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f0eefcba-ba49-463f-b75d-96e8aa7d7a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:25.048632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eefcba-ba49-463f-b75d-96e8aa7d7a32 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:25.120189 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7f36c-4bf5-4672-a0ce-5d1e41c5d739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:25.120786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7f36c-4bf5-4672-a0ce-5d1e41c5d739 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:25.121067 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7f36c-4bf5-4672-a0ce-5d1e41c5d739 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:25.121337 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7f36c-4bf5-4672-a0ce-5d1e41c5d739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:25.122943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-64e7f36c-4bf5-4672-a0ce-5d1e41c5d739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:25.149162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:25.231154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7f36c-4bf5-4672-a0ce-5d1e41c5d739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:25.232520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7f36c-4bf5-4672-a0ce-5d1e41c5d739 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:25.250509 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 659/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:17:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:17:27.242548 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a338ce6-c57d-44b8-a89d-1a8adddbec93 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:27.243083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a338ce6-c57d-44b8-a89d-1a8adddbec93 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:27.243083 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a338ce6-c57d-44b8-a89d-1a8adddbec93 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:27.244437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 676/1335] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:17:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:27.249757 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa37c63-a69a-410f-81a4-0e6271fce16e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:27.250246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa37c63-a69a-410f-81a4-0e6271fce16e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:27.250351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa37c63-a69a-410f-81a4-0e6271fce16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:27.315501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6aa37c63-a69a-410f-81a4-0e6271fce16e None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:27.316695 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6aa37c63-a69a-410f-81a4-0e6271fce16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:27.390151 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:27.414960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 660/1336] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:27.703793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a338ce6-c57d-44b8-a89d-1a8adddbec93 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:27.705316 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-3a338ce6-c57d-44b8-a89d-1a8adddbec93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:27.811006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a338ce6-c57d-44b8-a89d-1a8adddbec93 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:27.839064 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:27.884939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5468c4-b389-445d-a13f-1a59a8b1de63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:27.885540 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5468c4-b389-445d-a13f-1a59a8b1de63 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:27.885820 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5468c4-b389-445d-a13f-1a59a8b1de63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:27.886113 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5468c4-b389-445d-a13f-1a59a8b1de63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:27.887701 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6c5468c4-b389-445d-a13f-1a59a8b1de63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:27.994801 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5468c4-b389-445d-a13f-1a59a8b1de63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:27.996152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5468c4-b389-445d-a13f-1a59a8b1de63 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:28.014432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 677/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:17:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:17:30.276936 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dbea3-cacb-4f27-8eaf-f05271332517 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:30.277447 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dbea3-cacb-4f27-8eaf-f05271332517 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:30.277539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dbea3-cacb-4f27-8eaf-f05271332517 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:30.278879 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 661/1338] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:30.284250 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b247b84-0313-4e4b-8c2d-a1b84f0fe1f6 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:30.284673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b247b84-0313-4e4b-8c2d-a1b84f0fe1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:30.284811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b247b84-0313-4e4b-8c2d-a1b84f0fe1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:30.350901 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-3b247b84-0313-4e4b-8c2d-a1b84f0fe1f6 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:30.352096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-3b247b84-0313-4e4b-8c2d-a1b84f0fe1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:30.360212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:30.448921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 678/1339] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:30.737106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dbea3-cacb-4f27-8eaf-f05271332517 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:30.738691 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9b0dbea3-cacb-4f27-8eaf-f05271332517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:30.840020 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dbea3-cacb-4f27-8eaf-f05271332517 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:30.911046 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1d1ea-e934-42d6-b5ec-e0532a4bf9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:30.911641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1d1ea-e934-42d6-b5ec-e0532a4bf9ac service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:30.911920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1d1ea-e934-42d6-b5ec-e0532a4bf9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:30.912195 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1d1ea-e934-42d6-b5ec-e0532a4bf9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:30.913946 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9fb1d1ea-e934-42d6-b5ec-e0532a4bf9ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:30.948213 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:31.026802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1d1ea-e934-42d6-b5ec-e0532a4bf9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:31.028151 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1d1ea-e934-42d6-b5ec-e0532a4bf9ac service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:31.046127 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 662/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:17:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:17:35.014570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bf115-a0d2-41b4-b42f-145241467173 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:35.015073 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bf115-a0d2-41b4-b42f-145241467173 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:35.015264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bf115-a0d2-41b4-b42f-145241467173 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:35.016666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 679/1341] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:35.022344 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450abc4e-e59f-4ae8-9894-22b61df3fe3b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:35.022814 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450abc4e-e59f-4ae8-9894-22b61df3fe3b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:35.023464 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450abc4e-e59f-4ae8-9894-22b61df3fe3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:35.090781 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-450abc4e-e59f-4ae8-9894-22b61df3fe3b None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:35.091983 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-450abc4e-e59f-4ae8-9894-22b61df3fe3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:35.180167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:35.192098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 663/1342] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:35.481244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bf115-a0d2-41b4-b42f-145241467173 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:35.482806 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-052bf115-a0d2-41b4-b42f-145241467173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:35.598505 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bf115-a0d2-41b4-b42f-145241467173 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:35.638045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:35.676096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69b8b4-3ea8-4f28-ad70-32caacc001c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:35.676699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69b8b4-3ea8-4f28-ad70-32caacc001c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:35.676985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69b8b4-3ea8-4f28-ad70-32caacc001c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:35.677255 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69b8b4-3ea8-4f28-ad70-32caacc001c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:35.679490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9f69b8b4-3ea8-4f28-ad70-32caacc001c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:35.795219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f69b8b4-3ea8-4f28-ad70-32caacc001c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:35.796615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f69b8b4-3ea8-4f28-ad70-32caacc001c1 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:35.814785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 680/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:17:38.362624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bf536-cc2c-4f8d-adfe-1cec9f03de7f None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:38.363212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bf536-cc2c-4f8d-adfe-1cec9f03de7f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:38.363212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bf536-cc2c-4f8d-adfe-1cec9f03de7f None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:38.364581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 664/1344] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:38.370252 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdab752-3ae4-4139-924b-59b6f3fa42a1 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:38.370658 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdab752-3ae4-4139-924b-59b6f3fa42a1 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:38.370834 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdab752-3ae4-4139-924b-59b6f3fa42a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:38.441503 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-bbdab752-3ae4-4139-924b-59b6f3fa42a1 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:38.442656 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-bbdab752-3ae4-4139-924b-59b6f3fa42a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:38.460938 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:38.542767 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 681/1345] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:38.847084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bf536-cc2c-4f8d-adfe-1cec9f03de7f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:38.848611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dc5bf536-cc2c-4f8d-adfe-1cec9f03de7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:38.956201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bf536-cc2c-4f8d-adfe-1cec9f03de7f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:39.032661 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef73549-eb73-428f-a5c0-86662246c08b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:39.033282 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef73549-eb73-428f-a5c0-86662246c08b service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:39.033559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef73549-eb73-428f-a5c0-86662246c08b service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:39.033829 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef73549-eb73-428f-a5c0-86662246c08b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:39.035616 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8ef73549-eb73-428f-a5c0-86662246c08b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:39.084561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:39.152781 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef73549-eb73-428f-a5c0-86662246c08b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:39.154144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef73549-eb73-428f-a5c0-86662246c08b service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:39.173866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 665/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:17:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:17:43.158692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f38c0f-47cd-4969-be32-1987efdfccb8 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:43.160512 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f38c0f-47cd-4969-be32-1987efdfccb8 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:43.161058 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f38c0f-47cd-4969-be32-1987efdfccb8 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:43.163645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 682/1347] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:17:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:43.169137 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b552c8-8606-49c9-bbd4-c756b60df733 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:43.169654 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b552c8-8606-49c9-bbd4-c756b60df733 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:43.169654 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b552c8-8606-49c9-bbd4-c756b60df733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:43.245862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a3b552c8-8606-49c9-bbd4-c756b60df733 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:43.247143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a3b552c8-8606-49c9-bbd4-c756b60df733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:43.350242 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:43.354096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 666/1348] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:17:43.638354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f38c0f-47cd-4969-be32-1987efdfccb8 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:43.639895 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f4f38c0f-47cd-4969-be32-1987efdfccb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:43.746481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f38c0f-47cd-4969-be32-1987efdfccb8 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:43.798440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:43.825756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcadb6-b2cd-484c-a998-d7145ad61932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:43.826405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcadb6-b2cd-484c-a998-d7145ad61932 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:43.826687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcadb6-b2cd-484c-a998-d7145ad61932 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:43.826959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcadb6-b2cd-484c-a998-d7145ad61932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:43.828553 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b7bcadb6-b2cd-484c-a998-d7145ad61932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:43.938894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcadb6-b2cd-484c-a998-d7145ad61932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:43.940241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcadb6-b2cd-484c-a998-d7145ad61932 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:43.958535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 683/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:17:48.967662 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7664d-2e19-4dea-8030-143fb9f809c2 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:48.968166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7664d-2e19-4dea-8030-143fb9f809c2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:48.968264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7664d-2e19-4dea-8030-143fb9f809c2 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:48.969710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 667/1350] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 23 16:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:48.976545 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a03fb5-03b7-4e2d-b5dd-10563c9605ac None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:48.977395 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a03fb5-03b7-4e2d-b5dd-10563c9605ac None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:48.977977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a03fb5-03b7-4e2d-b5dd-10563c9605ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:49.087464 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-70a03fb5-03b7-4e2d-b5dd-10563c9605ac None None] MFA Rules not processed for user `9cd1309c315e49eea6af4691d14c3e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:49.094096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-70a03fb5-03b7-4e2d-b5dd-10563c9605ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:49.141827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:49.261230 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 684/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 23 16:17:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:53.523107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c58643-42ab-4324-bcbb-f48ec1f32511 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:53.523952 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c58643-42ab-4324-bcbb-f48ec1f32511 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:53.524237 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c58643-42ab-4324-bcbb-f48ec1f32511 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:53.525586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 668/1352] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 23 16:17:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:53.530532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38698936-0863-419f-b66a-a7cf0ca309b6 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:53.530957 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38698936-0863-419f-b66a-a7cf0ca309b6 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:53.531163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38698936-0863-419f-b66a-a7cf0ca309b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:53.612784 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-38698936-0863-419f-b66a-a7cf0ca309b6 None None] MFA Rules not processed for user `9cd1309c315e49eea6af4691d14c3e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:53.614436 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-38698936-0863-419f-b66a-a7cf0ca309b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:53.695454 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:53.739500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 685/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 23 16:17:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:55.179192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23738b5-19e3-4366-a94b-bf61b6a8ebc1 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:55.179745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23738b5-19e3-4366-a94b-bf61b6a8ebc1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:55.179745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23738b5-19e3-4366-a94b-bf61b6a8ebc1 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:55.181064 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 669/1354] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 23 16:17:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:55.186378 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58647dd-924b-466e-bb54-077294dd671c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:55.186837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58647dd-924b-466e-bb54-077294dd671c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:55.187209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58647dd-924b-466e-bb54-077294dd671c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:55.265048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-a58647dd-924b-466e-bb54-077294dd671c None None] MFA Rules not processed for user `9cd1309c315e49eea6af4691d14c3e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:55.266395 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a58647dd-924b-466e-bb54-077294dd671c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:55.376068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 686/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 23 16:17:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:17:58.791255 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957447a-8e20-4baf-a4f8-b8ff76f1e6ef None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:58.791730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957447a-8e20-4baf-a4f8-b8ff76f1e6ef None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:58.791813 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957447a-8e20-4baf-a4f8-b8ff76f1e6ef None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:58.793128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 670/1356] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:58.798754 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250746f-8321-4c5a-bda3-d0068c334351 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:58.799157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250746f-8321-4c5a-bda3-d0068c334351 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:58.799603 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250746f-8321-4c5a-bda3-d0068c334351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:58.842018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:58.887862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f250746f-8321-4c5a-bda3-d0068c334351 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:58.889080 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f250746f-8321-4c5a-bda3-d0068c334351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:58.997100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 687/1357] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:59.317973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea926d26-57de-427f-986b-e8e023a7f694 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:59.318335 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea926d26-57de-427f-986b-e8e023a7f694 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:59.318954 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea926d26-57de-427f-986b-e8e023a7f694 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:59.320783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 671/1358] 10.222.0.16 () {54 vars in 962 bytes} [Tue Aug 23 16:17:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:17:59.331458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cade8f6-4552-473c-9cd5-40f325612eb6 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:59.332064 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cade8f6-4552-473c-9cd5-40f325612eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:59.333813 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cade8f6-4552-473c-9cd5-40f325612eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:59.418097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-9cade8f6-4552-473c-9cd5-40f325612eb6 None None] MFA Rules not processed for user `767ca33ca8e244f8a0cc773e3b6abefb`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:17:59.419330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9cade8f6-4552-473c-9cd5-40f325612eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:59.469756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:59.548459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 688/1359] 10.222.0.16 () {58 vars in 1059 bytes} [Tue Aug 23 16:17:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:17:59.556636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea926d26-57de-427f-986b-e8e023a7f694 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:17:59.558717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ea926d26-57de-427f-986b-e8e023a7f694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:59.722301 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea926d26-57de-427f-986b-e8e023a7f694 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:17:59.804155 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:17:59.848928 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a2737-e3d7-4b37-afad-26000bece966 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:17:59.849704 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2737-e3d7-4b37-afad-26000bece966 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:17:59.849989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2737-e3d7-4b37-afad-26000bece966 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:17:59.850289 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2737-e3d7-4b37-afad-26000bece966 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:17:59.851899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3f5a2737-e3d7-4b37-afad-26000bece966 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:17:59.946110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a2737-e3d7-4b37-afad-26000bece966 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:17:59.947715 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a2737-e3d7-4b37-afad-26000bece966 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:17:59.968622 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 672/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:18:02.117555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac42bd5-1923-4a11-ac23-d9a44beba0eb None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:02.118054 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac42bd5-1923-4a11-ac23-d9a44beba0eb None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:02.118054 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac42bd5-1923-4a11-ac23-d9a44beba0eb None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:02.119364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 689/1361] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:02.124591 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a952f4-4436-4a92-b744-4f9cd5c3a563 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:02.124986 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a952f4-4436-4a92-b744-4f9cd5c3a563 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:02.125141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a952f4-4436-4a92-b744-4f9cd5c3a563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:02.200801 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-30a952f4-4436-4a92-b744-4f9cd5c3a563 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:02.202205 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-30a952f4-4436-4a92-b744-4f9cd5c3a563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:02.243536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:02.322133 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 673/1362] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:02.613830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac42bd5-1923-4a11-ac23-d9a44beba0eb None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:02.615450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-3ac42bd5-1923-4a11-ac23-d9a44beba0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:02.781180 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac42bd5-1923-4a11-ac23-d9a44beba0eb None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:02.791164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:02.901627 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764e02b-3019-4229-b7f4-f83644f33c2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:02.902485 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764e02b-3019-4229-b7f4-f83644f33c2c service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:02.902602 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764e02b-3019-4229-b7f4-f83644f33c2c service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:02.902827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764e02b-3019-4229-b7f4-f83644f33c2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:02.904501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-3764e02b-3019-4229-b7f4-f83644f33c2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:03.005250 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764e02b-3019-4229-b7f4-f83644f33c2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:03.006991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764e02b-3019-4229-b7f4-f83644f33c2c service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:03.026574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 690/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:18:05.282325 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d5122-7b47-4f3e-8566-a509dc2889f0 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:05.282906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d5122-7b47-4f3e-8566-a509dc2889f0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:05.282906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d5122-7b47-4f3e-8566-a509dc2889f0 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:05.284200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 674/1364] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:05.290351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5e8c6-8e87-44f0-af1f-59239ed5b189 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:05.290819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5e8c6-8e87-44f0-af1f-59239ed5b189 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:05.290924 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5e8c6-8e87-44f0-af1f-59239ed5b189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:05.307680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:05.367556 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-15f5e8c6-8e87-44f0-af1f-59239ed5b189 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:05.368759 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-15f5e8c6-8e87-44f0-af1f-59239ed5b189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:05.472735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 691/1365] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:05.760453 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e5b27-3040-44fc-963e-35de23659805 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:05.761139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e5b27-3040-44fc-963e-35de23659805 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:05.761482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e5b27-3040-44fc-963e-35de23659805 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:05.762984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 675/1366] 10.222.0.16 () {54 vars in 962 bytes} [Tue Aug 23 16:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:05.768445 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df5577-5d4d-4dea-a457-b1c6fab99a88 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:05.768832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df5577-5d4d-4dea-a457-b1c6fab99a88 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:05.769674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df5577-5d4d-4dea-a457-b1c6fab99a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:05.850834 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-c4df5577-5d4d-4dea-a457-b1c6fab99a88 None None] MFA Rules not processed for user `767ca33ca8e244f8a0cc773e3b6abefb`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:05.852042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c4df5577-5d4d-4dea-a457-b1c6fab99a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:05.887901 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:05.984866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 692/1367] 10.222.0.16 () {58 vars in 1059 bytes} [Tue Aug 23 16:18:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:05.993663 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e5b27-3040-44fc-963e-35de23659805 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:05.995217 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d46e5b27-3040-44fc-963e-35de23659805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:06.152596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e5b27-3040-44fc-963e-35de23659805 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:06.185006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:06.288440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f3503-6ec6-4dc3-8aec-ef7f77e0b793 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:06.289211 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f3503-6ec6-4dc3-8aec-ef7f77e0b793 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:06.289592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f3503-6ec6-4dc3-8aec-ef7f77e0b793 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:06.289978 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f3503-6ec6-4dc3-8aec-ef7f77e0b793 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:06.291703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b46f3503-6ec6-4dc3-8aec-ef7f77e0b793 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:06.386543 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f3503-6ec6-4dc3-8aec-ef7f77e0b793 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:06.388393 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f3503-6ec6-4dc3-8aec-ef7f77e0b793 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:06.408660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 676/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:18:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:18:07.022021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaac2c0-a96d-47aa-87db-1d599f6f5b23 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:07.022630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaac2c0-a96d-47aa-87db-1d599f6f5b23 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:07.022630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaac2c0-a96d-47aa-87db-1d599f6f5b23 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:07.024086 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 693/1369] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:07.029329 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fc87e-482b-4117-9960-5a86b02d7ca5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:07.029617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fc87e-482b-4117-9960-5a86b02d7ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:07.029915 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fc87e-482b-4117-9960-5a86b02d7ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:07.063812 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:07.102958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-be5fc87e-482b-4117-9960-5a86b02d7ca5 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:07.104158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-be5fc87e-482b-4117-9960-5a86b02d7ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:07.222649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 677/1370] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:07.811387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ba89e-e553-4182-aa2f-9dcceda7af3c None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:07.811387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ba89e-e553-4182-aa2f-9dcceda7af3c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:07.811387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ba89e-e553-4182-aa2f-9dcceda7af3c None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:07.818464 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 694/1371] 10.222.0.16 () {54 vars in 964 bytes} [Tue Aug 23 16:18:07 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:07.823382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a45b0-8d60-4cba-aadc-a37abbd4e135 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:07.823861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a45b0-8d60-4cba-aadc-a37abbd4e135 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:07.824143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a45b0-8d60-4cba-aadc-a37abbd4e135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:07.904902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c54a45b0-8d60-4cba-aadc-a37abbd4e135 None None] MFA Rules not processed for user `8ffa4002b4b24e6e9665dc349ad2f1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:07.906383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c54a45b0-8d60-4cba-aadc-a37abbd4e135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:07.959183 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:07.991607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 678/1372] 10.222.0.16 () {58 vars in 1061 bytes} [Tue Aug 23 16:18:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:07.999377 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ba89e-e553-4182-aa2f-9dcceda7af3c None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:08.000923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-3c9ba89e-e553-4182-aa2f-9dcceda7af3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:08.116091 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ba89e-e553-4182-aa2f-9dcceda7af3c None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:08.171139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:08.215151 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c6691-9a2f-42eb-9462-4a76daa8c3c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ffa4002b4b24e6e9665dc349ad2f1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:08.216382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c6691-9a2f-42eb-9462-4a76daa8c3c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:08.216382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c6691-9a2f-42eb-9462-4a76daa8c3c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:08.216571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c6691-9a2f-42eb-9462-4a76daa8c3c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:08.218627 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9c4c6691-9a2f-42eb-9462-4a76daa8c3c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:08.410293 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c6691-9a2f-42eb-9462-4a76daa8c3c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:08.411837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c6691-9a2f-42eb-9462-4a76daa8c3c7 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:08.434561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 695/1373] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:18:08.447217 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d0557-67d2-42b3-adc5-b18c10f3ed5a None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:08.447511 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d0557-67d2-42b3-adc5-b18c10f3ed5a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:08.447776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d0557-67d2-42b3-adc5-b18c10f3ed5a None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:08.452837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 679/1374] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:18:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:08.454858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1923027-d8de-4f69-929d-b585c2fd8f1f None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:08.455137 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1923027-d8de-4f69-929d-b585c2fd8f1f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:08.455389 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1923027-d8de-4f69-929d-b585c2fd8f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:08.574876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-d1923027-d8de-4f69-929d-b585c2fd8f1f None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:08.576603 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d1923027-d8de-4f69-929d-b585c2fd8f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:08.601726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:08.681173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 696/1375] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:08.967966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d0557-67d2-42b3-adc5-b18c10f3ed5a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:08.969478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-906d0557-67d2-42b3-adc5-b18c10f3ed5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:09.121985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d0557-67d2-42b3-adc5-b18c10f3ed5a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:09.181129 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:09.243714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d70c5-047c-4154-8b7b-021d54261bdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:09.244642 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d70c5-047c-4154-8b7b-021d54261bdf service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:09.244953 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d70c5-047c-4154-8b7b-021d54261bdf service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:09.245262 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d70c5-047c-4154-8b7b-021d54261bdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:09.246907 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ec1d70c5-047c-4154-8b7b-021d54261bdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:09.339034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d70c5-047c-4154-8b7b-021d54261bdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:09.340629 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d70c5-047c-4154-8b7b-021d54261bdf service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:09.358915 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 680/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:18:11.353775 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac334d-afbe-4504-9290-2a74f9a85029 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:11.354351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac334d-afbe-4504-9290-2a74f9a85029 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:11.354351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac334d-afbe-4504-9290-2a74f9a85029 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:11.355745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 697/1377] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:11.361034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84ccd5-f56b-4b27-9c73-27e50f008402 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:11.361475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84ccd5-f56b-4b27-9c73-27e50f008402 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:11.361579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84ccd5-f56b-4b27-9c73-27e50f008402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:11.431007 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ce84ccd5-f56b-4b27-9c73-27e50f008402 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:11.433676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ce84ccd5-f56b-4b27-9c73-27e50f008402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:11.439880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:11.565236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 681/1378] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:11.856736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac334d-afbe-4504-9290-2a74f9a85029 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:11.858313 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-dfac334d-afbe-4504-9290-2a74f9a85029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:12.046925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac334d-afbe-4504-9290-2a74f9a85029 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:12.053385 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:12.186286 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa8f55-fec7-4eb0-a3ff-0d8346671294 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:12.186914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa8f55-fec7-4eb0-a3ff-0d8346671294 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:12.187198 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa8f55-fec7-4eb0-a3ff-0d8346671294 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:12.187470 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa8f55-fec7-4eb0-a3ff-0d8346671294 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:12.189118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d4fa8f55-fec7-4eb0-a3ff-0d8346671294 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:12.298788 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa8f55-fec7-4eb0-a3ff-0d8346671294 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:12.301098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa8f55-fec7-4eb0-a3ff-0d8346671294 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:12.320119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 698/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:18:14.309838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf5b35-b0d3-44a4-93bf-09984a2cc7a0 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:14.310377 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf5b35-b0d3-44a4-93bf-09984a2cc7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:14.310484 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf5b35-b0d3-44a4-93bf-09984a2cc7a0 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:14.311900 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 682/1380] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:14.317810 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf6ee9-b361-4b90-8d6b-db2b92ba42cd None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:14.318269 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf6ee9-b361-4b90-8d6b-db2b92ba42cd None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:14.318375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf6ee9-b361-4b90-8d6b-db2b92ba42cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:14.330441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:14.398210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-71cf6ee9-b361-4b90-8d6b-db2b92ba42cd None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:14.398210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-71cf6ee9-b361-4b90-8d6b-db2b92ba42cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:14.505343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 699/1381] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:18:14.800868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf5b35-b0d3-44a4-93bf-09984a2cc7a0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:14.802641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b2cf5b35-b0d3-44a4-93bf-09984a2cc7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:14.965846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:14.977835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf5b35-b0d3-44a4-93bf-09984a2cc7a0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:15.101075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdded052-5195-45da-9f56-508d018999f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:15.101683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdded052-5195-45da-9f56-508d018999f5 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:15.101972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdded052-5195-45da-9f56-508d018999f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:15.102273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdded052-5195-45da-9f56-508d018999f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:15.103886 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cdded052-5195-45da-9f56-508d018999f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:15.208843 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdded052-5195-45da-9f56-508d018999f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:15.210523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdded052-5195-45da-9f56-508d018999f5 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:15.221920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:15.231591 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 683/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:18:17.195213 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e0a85-98d4-4098-966b-ac8335a1933d None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:17.195775 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e0a85-98d4-4098-966b-ac8335a1933d None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:17.195775 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e0a85-98d4-4098-966b-ac8335a1933d None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:17.197092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 700/1383] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:17.202792 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fce926-0c0b-4338-b69b-ecc2ef251329 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:17.203266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fce926-0c0b-4338-b69b-ecc2ef251329 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:17.203742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fce926-0c0b-4338-b69b-ecc2ef251329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:17.291858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-31fce926-0c0b-4338-b69b-ecc2ef251329 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:17.293376 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-31fce926-0c0b-4338-b69b-ecc2ef251329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:17.404694 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 684/1384] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:17.693272 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e0a85-98d4-4098-966b-ac8335a1933d None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:17.694843 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5f8e0a85-98d4-4098-966b-ac8335a1933d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:17.785646 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:17.865380 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e0a85-98d4-4098-966b-ac8335a1933d None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:17.993216 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1671b-16bf-422d-b620-3e32d11b2d9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:17.993751 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1671b-16bf-422d-b620-3e32d11b2d9f service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:17.994030 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1671b-16bf-422d-b620-3e32d11b2d9f service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:17.994333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1671b-16bf-422d-b620-3e32d11b2d9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:17.995948 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-d4a1671b-16bf-422d-b620-3e32d11b2d9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:18.048016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:18.095657 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1671b-16bf-422d-b620-3e32d11b2d9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:18.097965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1671b-16bf-422d-b620-3e32d11b2d9f service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:18.117156 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 701/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:18:20.063413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c5f6b-3122-4d8e-a7aa-ef55541d2c8a None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:20.064069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c5f6b-3122-4d8e-a7aa-ef55541d2c8a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:20.064069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c5f6b-3122-4d8e-a7aa-ef55541d2c8a None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:20.065662 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 685/1386] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:18:20.071193 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294e435-fe75-444a-8e68-4a08997c70d3 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:20.071733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294e435-fe75-444a-8e68-4a08997c70d3 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:20.071844 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294e435-fe75-444a-8e68-4a08997c70d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:20.142082 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-1294e435-fe75-444a-8e68-4a08997c70d3 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:20.144197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1294e435-fe75-444a-8e68-4a08997c70d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:20.252057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 702/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:20.547030 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c5f6b-3122-4d8e-a7aa-ef55541d2c8a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:20.548610 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6c1c5f6b-3122-4d8e-a7aa-ef55541d2c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:20.651133 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:20.738019 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c5f6b-3122-4d8e-a7aa-ef55541d2c8a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:20.859245 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42959cc4-fc4d-4d90-b87e-17d9f432521c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:20.859859 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42959cc4-fc4d-4d90-b87e-17d9f432521c service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:20.860143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42959cc4-fc4d-4d90-b87e-17d9f432521c service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:20.860419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42959cc4-fc4d-4d90-b87e-17d9f432521c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:20.862741 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-42959cc4-fc4d-4d90-b87e-17d9f432521c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:20.902193 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:20.956922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42959cc4-fc4d-4d90-b87e-17d9f432521c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:20.958660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42959cc4-fc4d-4d90-b87e-17d9f432521c service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:20.978190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 686/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:18:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:18:22.956983 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609cd52-e352-48e4-a701-a13507482a75 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:22.957532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609cd52-e352-48e4-a701-a13507482a75 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:22.957668 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609cd52-e352-48e4-a701-a13507482a75 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:22.959001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 703/1389] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:18:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:22.964441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10281d9-6ec2-461f-bd8d-3166a9e7ecb6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:22.964862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10281d9-6ec2-461f-bd8d-3166a9e7ecb6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:22.965017 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10281d9-6ec2-461f-bd8d-3166a9e7ecb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:23.032430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e10281d9-6ec2-461f-bd8d-3166a9e7ecb6 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:23.033755 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e10281d9-6ec2-461f-bd8d-3166a9e7ecb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:23.133177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 687/1390] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:23.427440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609cd52-e352-48e4-a701-a13507482a75 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:23.428972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c609cd52-e352-48e4-a701-a13507482a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:23.460551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:23.581260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609cd52-e352-48e4-a701-a13507482a75 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:23.685279 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:23.698017 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef910a5-68e0-4787-b92d-71dbc26cedbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:23.698639 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef910a5-68e0-4787-b92d-71dbc26cedbb service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:23.698916 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef910a5-68e0-4787-b92d-71dbc26cedbb service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:23.699185 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef910a5-68e0-4787-b92d-71dbc26cedbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:23.700763 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-fef910a5-68e0-4787-b92d-71dbc26cedbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:23.798350 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef910a5-68e0-4787-b92d-71dbc26cedbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:23.801489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef910a5-68e0-4787-b92d-71dbc26cedbb service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:23.824932 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 704/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:18:23.944420 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8982557-fca5-4261-8b67-80891ad1c194 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:23.944623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8982557-fca5-4261-8b67-80891ad1c194 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:23.944883 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8982557-fca5-4261-8b67-80891ad1c194 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:23.946387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 688/1392] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:23.952510 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3025071-c228-47ea-b201-b972f777ad5b None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:23.952796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3025071-c228-47ea-b201-b972f777ad5b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:23.953071 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3025071-c228-47ea-b201-b972f777ad5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:24.026043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f3025071-c228-47ea-b201-b972f777ad5b None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:24.027336 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f3025071-c228-47ea-b201-b972f777ad5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:24.087924 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:24.127884 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 705/1393] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:24.429542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deabf85-63d1-46a7-a816-610ab9da091c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:24.429982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deabf85-63d1-46a7-a816-610ab9da091c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:24.430126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deabf85-63d1-46a7-a816-610ab9da091c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:24.431457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 689/1394] 10.222.0.16 () {54 vars in 967 bytes} [Tue Aug 23 16:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:24.436351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee8683-4637-4e09-aad5-bfdf70652ead None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:24.436638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee8683-4637-4e09-aad5-bfdf70652ead None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:24.436935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee8683-4637-4e09-aad5-bfdf70652ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:24.515750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-4dee8683-4637-4e09-aad5-bfdf70652ead None None] MFA Rules not processed for user `d3ddab91bbb24d119dd302024f458d35`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:24.516893 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4dee8683-4637-4e09-aad5-bfdf70652ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:24.597841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 706/1395] 10.222.0.16 () {58 vars in 1064 bytes} [Tue Aug 23 16:18:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:24.605510 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deabf85-63d1-46a7-a816-610ab9da091c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:24.607129 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6deabf85-63d1-46a7-a816-610ab9da091c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:24.621885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:24.714528 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deabf85-63d1-46a7-a816-610ab9da091c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:24.788905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624d5b3-ed8f-4c72-b896-c991dc36b3f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3ddab91bbb24d119dd302024f458d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:24.789427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624d5b3-ed8f-4c72-b896-c991dc36b3f6 service glance] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:24.789711 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624d5b3-ed8f-4c72-b896-c991dc36b3f6 service glance] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:24.789984 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624d5b3-ed8f-4c72-b896-c991dc36b3f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:24.791642 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f624d5b3-ed8f-4c72-b896-c991dc36b3f6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:24.876198 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:24.923061 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624d5b3-ed8f-4c72-b896-c991dc36b3f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:24.924756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624d5b3-ed8f-4c72-b896-c991dc36b3f6 service glance] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:24.943284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 690/1396] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:18:25.706938 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77169742-5461-4789-80ea-3c8f936764cd None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:25.707422 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77169742-5461-4789-80ea-3c8f936764cd None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:25.707540 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77169742-5461-4789-80ea-3c8f936764cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:25.775599 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-77169742-5461-4789-80ea-3c8f936764cd None None] MFA Rules not processed for user `5fe3a02c2bc247efa354ca5bac39ec4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:25.776839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-77169742-5461-4789-80ea-3c8f936764cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:25.786277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:25.807942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f0335-0534-4970-9029-de881147c134 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:25.808502 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f0335-0534-4970-9029-de881147c134 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:25.808502 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f0335-0534-4970-9029-de881147c134 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:25.809889 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 691/1397] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:18:25.814903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892ec7b-3f29-4a98-a699-f3c53792c891 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:25.815184 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892ec7b-3f29-4a98-a699-f3c53792c891 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:25.815475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892ec7b-3f29-4a98-a699-f3c53792c891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:25.867855 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 707/1398] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 23 16:18:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:25.882942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e892ec7b-3f29-4a98-a699-f3c53792c891 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:25.884169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e892ec7b-3f29-4a98-a699-f3c53792c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:25.916135 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64c8f2-f852-453a-8456-cdf35efc9e80 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:25.916424 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64c8f2-f852-453a-8456-cdf35efc9e80 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:25.916702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64c8f2-f852-453a-8456-cdf35efc9e80 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:25.918039 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 708/1399] 10.222.0.16 () {54 vars in 943 bytes} [Tue Aug 23 16:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:18:25.924682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055129a-e96c-4ea5-b9c4-d4b18a3041b7 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:25.924973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055129a-e96c-4ea5-b9c4-d4b18a3041b7 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:25.925250 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7055129a-e96c-4ea5-b9c4-d4b18a3041b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:25.986583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 692/1400] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:18:26.005795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-7055129a-e96c-4ea5-b9c4-d4b18a3041b7 None None] MFA Rules not processed for user `e7fb290911bc4de887d04b71731f76b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:26.007059 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7055129a-e96c-4ea5-b9c4-d4b18a3041b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:26.091339 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:26.115812 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 709/1401] 10.222.0.16 () {58 vars in 1040 bytes} [Tue Aug 23 16:18:25 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:18:26.125370 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892ec7b-3f29-4a98-a699-f3c53792c891 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:26.127413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e892ec7b-3f29-4a98-a699-f3c53792c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:26.153429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:26.240177 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892ec7b-3f29-4a98-a699-f3c53792c891 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:26.284309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055129a-e96c-4ea5-b9c4-d4b18a3041b7 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:26.285526 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7055129a-e96c-4ea5-b9c4-d4b18a3041b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:26.349305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29454b-2ad5-4c43-bb1d-c425e62d7f33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fb290911bc4de887d04b71731f76b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:26.349911 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29454b-2ad5-4c43-bb1d-c425e62d7f33 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:26.350222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29454b-2ad5-4c43-bb1d-c425e62d7f33 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:26.350498 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29454b-2ad5-4c43-bb1d-c425e62d7f33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:26.352122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8e29454b-2ad5-4c43-bb1d-c425e62d7f33 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:26.385213 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7055129a-e96c-4ea5-b9c4-d4b18a3041b7 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:26.393581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:26.439615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29454b-2ad5-4c43-bb1d-c425e62d7f33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:26.441279 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29454b-2ad5-4c43-bb1d-c425e62d7f33 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:26.449547 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 693/1402] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 23 16:18:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:18:26.498089 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:26.506557 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc7e88-4a56-4535-8ce8-3f86d8eea58e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:26.507185 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc7e88-4a56-4535-8ce8-3f86d8eea58e service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:26.507560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc7e88-4a56-4535-8ce8-3f86d8eea58e service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:26.508316 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc7e88-4a56-4535-8ce8-3f86d8eea58e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:26.509943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-dffc7e88-4a56-4535-8ce8-3f86d8eea58e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:26.632114 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc7e88-4a56-4535-8ce8-3f86d8eea58e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:26.634010 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc7e88-4a56-4535-8ce8-3f86d8eea58e service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:26.662469 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 710/1403] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:18:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:18:28.670496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd8d66-0646-4e3c-b336-0d080b3729ad None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:28.671119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd8d66-0646-4e3c-b336-0d080b3729ad None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:28.671119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd8d66-0646-4e3c-b336-0d080b3729ad None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:28.672528 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 694/1404] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:28.679762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5ab92-a802-4870-8e97-a500dcc3b421 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:28.680266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5ab92-a802-4870-8e97-a500dcc3b421 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:28.680364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5ab92-a802-4870-8e97-a500dcc3b421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:28.752916 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e2a5ab92-a802-4870-8e97-a500dcc3b421 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:28.754146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e2a5ab92-a802-4870-8e97-a500dcc3b421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:28.826138 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:28.867084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 711/1405] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:29.167686 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd8d66-0646-4e3c-b336-0d080b3729ad None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:29.169224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9efd8d66-0646-4e3c-b336-0d080b3729ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:29.352484 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd8d66-0646-4e3c-b336-0d080b3729ad None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:29.391204 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:29.481049 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c9c26-0617-4895-afb8-977c40f2ab5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:29.481580 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c9c26-0617-4895-afb8-977c40f2ab5f service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:29.481862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c9c26-0617-4895-afb8-977c40f2ab5f service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:29.482162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c9c26-0617-4895-afb8-977c40f2ab5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:29.484019 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6e0c9c26-0617-4895-afb8-977c40f2ab5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:29.597920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c9c26-0617-4895-afb8-977c40f2ab5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:29.599672 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c9c26-0617-4895-afb8-977c40f2ab5f service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:29.619453 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 695/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:18:31.606191 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064b4c7-8765-41d7-90c8-aed1b732773c None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:31.606763 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064b4c7-8765-41d7-90c8-aed1b732773c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:31.608055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064b4c7-8765-41d7-90c8-aed1b732773c None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:31.610137 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 712/1407] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:18:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:31.615258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac7640-5200-46e4-9b3b-d68f4a169de3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:31.615710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac7640-5200-46e4-9b3b-d68f4a169de3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:31.615805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac7640-5200-46e4-9b3b-d68f4a169de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:31.690206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:31.724228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-efac7640-5200-46e4-9b3b-d68f4a169de3 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:31.725981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-efac7640-5200-46e4-9b3b-d68f4a169de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:31.889771 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 696/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:32.186588 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064b4c7-8765-41d7-90c8-aed1b732773c None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:32.188114 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4064b4c7-8765-41d7-90c8-aed1b732773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:32.363010 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064b4c7-8765-41d7-90c8-aed1b732773c None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:32.427691 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:32.507221 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781dcff-d231-480b-bec9-8d832e3dea40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:32.507835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781dcff-d231-480b-bec9-8d832e3dea40 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:32.508117 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781dcff-d231-480b-bec9-8d832e3dea40 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:32.508390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781dcff-d231-480b-bec9-8d832e3dea40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:32.510039 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8781dcff-d231-480b-bec9-8d832e3dea40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:32.619673 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781dcff-d231-480b-bec9-8d832e3dea40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:32.621415 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8781dcff-d231-480b-bec9-8d832e3dea40 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:32.641614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 713/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:18:41.887965 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=47 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:42.639164 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=75 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:48.868207 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6730b-9595-4fee-a264-53d149ebc18d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:48.868757 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6730b-9595-4fee-a264-53d149ebc18d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:48.868757 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6730b-9595-4fee-a264-53d149ebc18d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:48.870108 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 697/1410] 10.222.0.16 () {54 vars in 918 bytes} [Tue Aug 23 16:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:18:48.875142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a531b9-92b6-4035-a24c-9b73ed829265 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:48.876065 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a531b9-92b6-4035-a24c-9b73ed829265 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:48.876206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a531b9-92b6-4035-a24c-9b73ed829265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:48.954373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-79a531b9-92b6-4035-a24c-9b73ed829265 None None] MFA Rules not processed for user `9cd1309c315e49eea6af4691d14c3e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:48.955584 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-79a531b9-92b6-4035-a24c-9b73ed829265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:49.058474 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 714/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Tue Aug 23 16:18:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:49.073005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26c15d-8878-4e89-957b-657cd50b6b92 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:49.073312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26c15d-8878-4e89-957b-657cd50b6b92 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:49.073567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26c15d-8878-4e89-957b-657cd50b6b92 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:49.074973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 698/1412] 10.222.0.16 () {54 vars in 918 bytes} [Tue Aug 23 16:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:49.080361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def9779-fce7-4e81-b5a2-078939567b30 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:49.080644 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def9779-fce7-4e81-b5a2-078939567b30 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:49.080921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def9779-fce7-4e81-b5a2-078939567b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:49.153366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:49.156403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-0def9779-fce7-4e81-b5a2-078939567b30 None None] MFA Rules not processed for user `767ca33ca8e244f8a0cc773e3b6abefb`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:49.158441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-0def9779-fce7-4e81-b5a2-078939567b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:49.274729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 715/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Tue Aug 23 16:18:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:51.798955 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818e072-021f-4a22-ad57-6321e5cb8bed None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:51.799574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818e072-021f-4a22-ad57-6321e5cb8bed None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:51.799574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818e072-021f-4a22-ad57-6321e5cb8bed None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:51.800759 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 699/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:18:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:51.807785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e62c2-b6ce-4f76-b838-17e371c7c65a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:51.808263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e62c2-b6ce-4f76-b838-17e371c7c65a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:51.808383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e62c2-b6ce-4f76-b838-17e371c7c65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:51.885740 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f97e62c2-b6ce-4f76-b838-17e371c7c65a None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:51.887005 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f97e62c2-b6ce-4f76-b838-17e371c7c65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:51.954536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:51.997341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 716/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:52.291821 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818e072-021f-4a22-ad57-6321e5cb8bed None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:52.293384 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8818e072-021f-4a22-ad57-6321e5cb8bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:52.438937 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818e072-021f-4a22-ad57-6321e5cb8bed None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:52.511661 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:52.553106 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37a1a3-73c3-4a95-8719-63ff63fb7f52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:52.553713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37a1a3-73c3-4a95-8719-63ff63fb7f52 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:52.553995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37a1a3-73c3-4a95-8719-63ff63fb7f52 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:52.554297 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37a1a3-73c3-4a95-8719-63ff63fb7f52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:52.555898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9f37a1a3-73c3-4a95-8719-63ff63fb7f52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:52.645878 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37a1a3-73c3-4a95-8719-63ff63fb7f52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:52.647511 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37a1a3-73c3-4a95-8719-63ff63fb7f52 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:52.665086 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 700/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:18:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:18:53.556282 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f37a66-ed5a-4865-904c-6ea5884c9000 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:53.556825 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f37a66-ed5a-4865-904c-6ea5884c9000 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:53.556942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f37a66-ed5a-4865-904c-6ea5884c9000 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:53.558338 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 717/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:53.563729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61268513-29d3-4817-8a83-fd652dba6e87 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:53.564148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61268513-29d3-4817-8a83-fd652dba6e87 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:53.564382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61268513-29d3-4817-8a83-fd652dba6e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:53.640105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-61268513-29d3-4817-8a83-fd652dba6e87 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:53.641319 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-61268513-29d3-4817-8a83-fd652dba6e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:53.668851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:53.739200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 701/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:53.892942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f37a66-ed5a-4865-904c-6ea5884c9000 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:53.894403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-41f37a66-ed5a-4865-904c-6ea5884c9000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:54.037505 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f37a66-ed5a-4865-904c-6ea5884c9000 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:54.083967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:54.158241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9851a1b-75a5-4785-acc7-63ffadb93c45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:54.158789 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9851a1b-75a5-4785-acc7-63ffadb93c45 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:54.159070 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9851a1b-75a5-4785-acc7-63ffadb93c45 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:54.159337 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9851a1b-75a5-4785-acc7-63ffadb93c45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:54.161001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e9851a1b-75a5-4785-acc7-63ffadb93c45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:54.252101 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9851a1b-75a5-4785-acc7-63ffadb93c45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:54.253756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9851a1b-75a5-4785-acc7-63ffadb93c45 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:54.272728 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 718/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:18:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:18:55.202532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13387e-ffca-4605-b067-a60565048f32 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:55.203026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13387e-ffca-4605-b067-a60565048f32 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:55.203133 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13387e-ffca-4605-b067-a60565048f32 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:55.204540 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 702/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:55.209836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c401339-7c28-4a40-9ba6-15f95948b421 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:55.210321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c401339-7c28-4a40-9ba6-15f95948b421 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:55.210559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c401339-7c28-4a40-9ba6-15f95948b421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:55.265325 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:55.287623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-7c401339-7c28-4a40-9ba6-15f95948b421 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:55.288835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7c401339-7c28-4a40-9ba6-15f95948b421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:55.383968 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 719/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:18:55.536851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13387e-ffca-4605-b067-a60565048f32 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:55.538303 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fb13387e-ffca-4605-b067-a60565048f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:55.693772 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13387e-ffca-4605-b067-a60565048f32 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:55.705804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:55.807176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714221a-5991-4dae-b33b-5b01cdc3f530 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:55.807780 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714221a-5991-4dae-b33b-5b01cdc3f530 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:55.808054 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714221a-5991-4dae-b33b-5b01cdc3f530 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:55.808321 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714221a-5991-4dae-b33b-5b01cdc3f530 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:55.809898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c714221a-5991-4dae-b33b-5b01cdc3f530 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:55.898780 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714221a-5991-4dae-b33b-5b01cdc3f530 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:55.900369 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714221a-5991-4dae-b33b-5b01cdc3f530 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:55.918521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 703/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:18:56.791882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a1512-aaa7-41cd-aaae-272c7f54f3ad None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:56.792467 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a1512-aaa7-41cd-aaae-272c7f54f3ad None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:56.792467 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a1512-aaa7-41cd-aaae-272c7f54f3ad None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:56.793756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 720/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:56.798851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0b717-ef0a-470c-b714-7ab7e8fce732 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:56.799310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0b717-ef0a-470c-b714-7ab7e8fce732 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:56.799418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0b717-ef0a-470c-b714-7ab7e8fce732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:56.819764 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:56.875571 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d8a0b717-ef0a-470c-b714-7ab7e8fce732 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:56.876906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d8a0b717-ef0a-470c-b714-7ab7e8fce732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:56.973849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 704/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:57.128451 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a1512-aaa7-41cd-aaae-272c7f54f3ad None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:57.129975 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-0e2a1512-aaa7-41cd-aaae-272c7f54f3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:57.240378 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:57.281200 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a1512-aaa7-41cd-aaae-272c7f54f3ad None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:57.413979 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070591b-9fd7-4ab6-96e7-e6d0f28c3ed8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:57.414936 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070591b-9fd7-4ab6-96e7-e6d0f28c3ed8 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:57.415224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070591b-9fd7-4ab6-96e7-e6d0f28c3ed8 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:57.415496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070591b-9fd7-4ab6-96e7-e6d0f28c3ed8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:57.417564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6070591b-9fd7-4ab6-96e7-e6d0f28c3ed8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:57.498214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:57.512592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070591b-9fd7-4ab6-96e7-e6d0f28c3ed8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:57.514231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070591b-9fd7-4ab6-96e7-e6d0f28c3ed8 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:57.532529 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 721/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:18:58.398750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55ad3e-7dbb-49b6-82ec-84f20e082066 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:58.399322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55ad3e-7dbb-49b6-82ec-84f20e082066 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:58.399322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55ad3e-7dbb-49b6-82ec-84f20e082066 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:58.400857 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 705/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:58.405841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4cfa6-b38c-453e-aeef-844fdb91cdcc None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:58.406263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4cfa6-b38c-453e-aeef-844fdb91cdcc None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:58.406428 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4cfa6-b38c-453e-aeef-844fdb91cdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:58.485635 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-eba4cfa6-b38c-453e-aeef-844fdb91cdcc None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:18:58.486794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-eba4cfa6-b38c-453e-aeef-844fdb91cdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:58.584928 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 722/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:18:58.737288 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55ad3e-7dbb-49b6-82ec-84f20e082066 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:18:58.738753 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8a55ad3e-7dbb-49b6-82ec-84f20e082066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:58.824981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:58.886497 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55ad3e-7dbb-49b6-82ec-84f20e082066 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:18:58.997791 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6118966-34c4-4410-a317-7bc9361ef08e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:18:58.998334 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6118966-34c4-4410-a317-7bc9361ef08e service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:58.998612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6118966-34c4-4410-a317-7bc9361ef08e service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:58.998880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6118966-34c4-4410-a317-7bc9361ef08e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:59.000478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d6118966-34c4-4410-a317-7bc9361ef08e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:18:59.049786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:18:59.092123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6118966-34c4-4410-a317-7bc9361ef08e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:18:59.093725 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6118966-34c4-4410-a317-7bc9361ef08e service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:18:59.112661 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 706/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:18:59.923917 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4639574-efc5-45c6-b8a0-9a8cf891fabc None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:59.924486 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4639574-efc5-45c6-b8a0-9a8cf891fabc None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:59.924486 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4639574-efc5-45c6-b8a0-9a8cf891fabc None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:18:59.925835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 723/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:18:59.930696 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5365c-7b35-4c0f-9364-44317b9264ed None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:18:59.931133 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5365c-7b35-4c0f-9364-44317b9264ed None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:18:59.931242 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5365c-7b35-4c0f-9364-44317b9264ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:00.006607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-45c5365c-7b35-4c0f-9364-44317b9264ed None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:00.007799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-45c5365c-7b35-4c0f-9364-44317b9264ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:00.101730 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 707/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:19:00.254763 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4639574-efc5-45c6-b8a0-9a8cf891fabc None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:00.256265 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c4639574-efc5-45c6-b8a0-9a8cf891fabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:00.304736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:00.401458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4639574-efc5-45c6-b8a0-9a8cf891fabc None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:00.515052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ca8bb-fed7-4af0-b1b9-7f6353e01872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:00.515567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ca8bb-fed7-4af0-b1b9-7f6353e01872 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:00.515841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ca8bb-fed7-4af0-b1b9-7f6353e01872 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:00.516125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ca8bb-fed7-4af0-b1b9-7f6353e01872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:00.518308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-329ca8bb-fed7-4af0-b1b9-7f6353e01872 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:00.525295 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:00.608801 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ca8bb-fed7-4af0-b1b9-7f6353e01872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:00.610997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ca8bb-fed7-4af0-b1b9-7f6353e01872 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:00.630120 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 724/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:19:01.429785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65f325-b62f-4b83-8de1-a1dd52b6bfc7 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:01.430343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65f325-b62f-4b83-8de1-a1dd52b6bfc7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:01.430343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65f325-b62f-4b83-8de1-a1dd52b6bfc7 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:01.431657 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 708/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:01.436720 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef3ad8-2e45-470e-9512-3922a7ee25c5 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:01.437127 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef3ad8-2e45-470e-9512-3922a7ee25c5 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:01.437270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef3ad8-2e45-470e-9512-3922a7ee25c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:01.514116 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e2ef3ad8-2e45-470e-9512-3922a7ee25c5 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:01.515342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e2ef3ad8-2e45-470e-9512-3922a7ee25c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:01.586269 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:01.615210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 725/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:19:01.766307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65f325-b62f-4b83-8de1-a1dd52b6bfc7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:01.768570 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4f65f325-b62f-4b83-8de1-a1dd52b6bfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:01.786428 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:01.915423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65f325-b62f-4b83-8de1-a1dd52b6bfc7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:02.000457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:02.026478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf27ec0-0c07-44d0-8842-67a9a2775110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:02.027008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf27ec0-0c07-44d0-8842-67a9a2775110 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:02.027283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf27ec0-0c07-44d0-8842-67a9a2775110 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:02.027551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf27ec0-0c07-44d0-8842-67a9a2775110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:02.029124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2bf27ec0-0c07-44d0-8842-67a9a2775110 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:02.116094 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf27ec0-0c07-44d0-8842-67a9a2775110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:02.117681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf27ec0-0c07-44d0-8842-67a9a2775110 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:02.138447 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 709/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:19:02.955563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a36bf-a314-420a-8e03-59ad416b236e None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:02.956096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a36bf-a314-420a-8e03-59ad416b236e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:02.956096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a36bf-a314-420a-8e03-59ad416b236e None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:02.957381 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 726/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:19:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:02.962235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9b27-7533-47c9-a236-5c01be17d031 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:02.962650 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9b27-7533-47c9-a236-5c01be17d031 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:02.962787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9b27-7533-47c9-a236-5c01be17d031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:03.040353 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6d0b9b27-7533-47c9-a236-5c01be17d031 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:03.041558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6d0b9b27-7533-47c9-a236-5c01be17d031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:03.082838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:03.137796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 710/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:19:03.293033 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a36bf-a314-420a-8e03-59ad416b236e None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:03.294529 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-624a36bf-a314-420a-8e03-59ad416b236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:03.439855 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a36bf-a314-420a-8e03-59ad416b236e None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:03.494101 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:03.555654 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498c798-8bbe-4c4c-9e21-327a34d4d1a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:03.556449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498c798-8bbe-4c4c-9e21-327a34d4d1a6 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:03.556794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498c798-8bbe-4c4c-9e21-327a34d4d1a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:03.557110 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498c798-8bbe-4c4c-9e21-327a34d4d1a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:03.559253 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-8498c798-8bbe-4c4c-9e21-327a34d4d1a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:03.651972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498c798-8bbe-4c4c-9e21-327a34d4d1a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:03.653577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498c798-8bbe-4c4c-9e21-327a34d4d1a6 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:03.671163 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 727/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:19:04.498294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12235d-776c-438c-aafe-5f473b493507 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:04.498816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12235d-776c-438c-aafe-5f473b493507 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:04.498816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12235d-776c-438c-aafe-5f473b493507 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:04.500312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 711/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:04.505241 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50033218-2dac-477d-bec6-a1fd79a5e118 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:04.505721 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50033218-2dac-477d-bec6-a1fd79a5e118 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:04.505826 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50033218-2dac-477d-bec6-a1fd79a5e118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:04.586959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-50033218-2dac-477d-bec6-a1fd79a5e118 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:04.588180 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-50033218-2dac-477d-bec6-a1fd79a5e118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:04.590213 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:04.686735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 728/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:19:04.837150 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12235d-776c-438c-aafe-5f473b493507 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:04.838776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4d12235d-776c-438c-aafe-5f473b493507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:04.987041 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12235d-776c-438c-aafe-5f473b493507 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:05.012596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:05.100750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a59060-cf29-4970-8703-0270d7d459b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:05.101263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a59060-cf29-4970-8703-0270d7d459b7 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:05.101542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a59060-cf29-4970-8703-0270d7d459b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:05.101812 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a59060-cf29-4970-8703-0270d7d459b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:05.103428 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-46a59060-cf29-4970-8703-0270d7d459b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:05.192999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a59060-cf29-4970-8703-0270d7d459b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:05.194638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a59060-cf29-4970-8703-0270d7d459b7 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:05.213078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 712/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:19:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:19:07.029415 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05587395-b65d-40f2-8846-b352f615679c None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:07.029960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05587395-b65d-40f2-8846-b352f615679c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:07.029960 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05587395-b65d-40f2-8846-b352f615679c None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:07.031363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 729/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:07.037528 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd64a9-efa3-4350-b07c-4440d69490dc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:07.037963 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd64a9-efa3-4350-b07c-4440d69490dc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:07.038153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd64a9-efa3-4350-b07c-4440d69490dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:07.080265 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:07.105935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b9fd64a9-efa3-4350-b07c-4440d69490dc None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:07.107181 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b9fd64a9-efa3-4350-b07c-4440d69490dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:07.205388 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 713/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:19:07.490057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05587395-b65d-40f2-8846-b352f615679c None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:07.491638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-05587395-b65d-40f2-8846-b352f615679c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:07.596530 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05587395-b65d-40f2-8846-b352f615679c None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:07.628910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:07.672245 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db8d1a-dc18-4192-8ddf-4e9954922f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:07.672845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db8d1a-dc18-4192-8ddf-4e9954922f4b service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:07.673124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db8d1a-dc18-4192-8ddf-4e9954922f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:07.673537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db8d1a-dc18-4192-8ddf-4e9954922f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:07.675193 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a0db8d1a-dc18-4192-8ddf-4e9954922f4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:07.788943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db8d1a-dc18-4192-8ddf-4e9954922f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:07.790324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db8d1a-dc18-4192-8ddf-4e9954922f4b service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:07.808149 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 730/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:19:09.878347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43505e99-cd20-477f-b5d4-3c6d3986efb7 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:09.878925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43505e99-cd20-477f-b5d4-3c6d3986efb7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:09.879257 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43505e99-cd20-477f-b5d4-3c6d3986efb7 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:09.880650 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 714/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:09.886136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccc5a6-d23b-4b05-9448-62cbad1c9a0a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:09.886564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccc5a6-d23b-4b05-9448-62cbad1c9a0a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:09.886694 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccc5a6-d23b-4b05-9448-62cbad1c9a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:09.952140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e1ccc5a6-d23b-4b05-9448-62cbad1c9a0a None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:09.953256 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e1ccc5a6-d23b-4b05-9448-62cbad1c9a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:09.966042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:10.051733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 731/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:19:10.353105 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43505e99-cd20-477f-b5d4-3c6d3986efb7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:10.354671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-43505e99-cd20-477f-b5d4-3c6d3986efb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:10.458800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43505e99-cd20-477f-b5d4-3c6d3986efb7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:10.471338 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:10.532235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0912b0-366e-4114-8d71-23e356f717f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:10.533457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0912b0-366e-4114-8d71-23e356f717f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:10.533832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0912b0-366e-4114-8d71-23e356f717f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:10.534158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0912b0-366e-4114-8d71-23e356f717f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:10.535744 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9c0912b0-366e-4114-8d71-23e356f717f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:10.645797 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0912b0-366e-4114-8d71-23e356f717f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:10.647535 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0912b0-366e-4114-8d71-23e356f717f7 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:10.665437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 715/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:19:12.886886 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0ac7c-a97a-45c5-90bb-bba06c06d58f None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:12.887475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0ac7c-a97a-45c5-90bb-bba06c06d58f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:12.887475 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0ac7c-a97a-45c5-90bb-bba06c06d58f None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:12.888806 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 732/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:12.895331 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d72a8-b5ce-4428-b72d-5b9068943b49 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:12.895727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d72a8-b5ce-4428-b72d-5b9068943b49 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:12.895882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d72a8-b5ce-4428-b72d-5b9068943b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:12.953216 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:12.972037 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-105d72a8-b5ce-4428-b72d-5b9068943b49 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:12.973239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-105d72a8-b5ce-4428-b72d-5b9068943b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:13.070743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 716/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:19:13.359954 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0ac7c-a97a-45c5-90bb-bba06c06d58f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:13.362294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6cc0ac7c-a97a-45c5-90bb-bba06c06d58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:13.463772 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0ac7c-a97a-45c5-90bb-bba06c06d58f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:13.503398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:13.537341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95deec00-d357-465e-b5f7-b7379f0872e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:13.537972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deec00-d357-465e-b5f7-b7379f0872e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:13.538275 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deec00-d357-465e-b5f7-b7379f0872e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:13.538562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95deec00-d357-465e-b5f7-b7379f0872e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:13.540182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-95deec00-d357-465e-b5f7-b7379f0872e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:13.663773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95deec00-d357-465e-b5f7-b7379f0872e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:13.665224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95deec00-d357-465e-b5f7-b7379f0872e9 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:13.683693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 733/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:19:15.742583 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8cfd5-0348-4f0d-828f-368ead7caed1 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:15.743182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8cfd5-0348-4f0d-828f-368ead7caed1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:15.743182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8cfd5-0348-4f0d-828f-368ead7caed1 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:15.744458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 717/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:15.749691 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda10b2-b751-43a8-96a7-0365fa781c91 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:15.750114 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda10b2-b751-43a8-96a7-0365fa781c91 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:15.750289 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda10b2-b751-43a8-96a7-0365fa781c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:15.817413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-ddda10b2-b751-43a8-96a7-0365fa781c91 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:15.818643 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ddda10b2-b751-43a8-96a7-0365fa781c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:15.838894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:15.915523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 734/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:19:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:19:16.199044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8cfd5-0348-4f0d-828f-368ead7caed1 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:16.200568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a3d8cfd5-0348-4f0d-828f-368ead7caed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:16.305172 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8cfd5-0348-4f0d-828f-368ead7caed1 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:16.325266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:16.378001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ea78b-dc5c-4f52-af96-9480e751b950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:16.378628 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ea78b-dc5c-4f52-af96-9480e751b950 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:16.378937 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ea78b-dc5c-4f52-af96-9480e751b950 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:16.379210 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ea78b-dc5c-4f52-af96-9480e751b950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:16.380807 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d02ea78b-dc5c-4f52-af96-9480e751b950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:16.490157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ea78b-dc5c-4f52-af96-9480e751b950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:16.491501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ea78b-dc5c-4f52-af96-9480e751b950 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:16.509908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 718/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:19:18.481898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3392d09-3b43-4100-9569-082a71f21514 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:18.482465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3392d09-3b43-4100-9569-082a71f21514 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:18.482465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3392d09-3b43-4100-9569-082a71f21514 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:18.483744 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 735/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:18.489797 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2cf57-378c-4814-9628-f1850a3670f2 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:18.490279 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2cf57-378c-4814-9628-f1850a3670f2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:18.490474 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2cf57-378c-4814-9628-f1850a3670f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:18.553847 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:18.556809 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-bbc2cf57-378c-4814-9628-f1850a3670f2 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:18.558584 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bbc2cf57-378c-4814-9628-f1850a3670f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:18.654640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 719/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:19:18.943093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3392d09-3b43-4100-9569-082a71f21514 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:18.944666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a3392d09-3b43-4100-9569-082a71f21514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:19.050139 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3392d09-3b43-4100-9569-082a71f21514 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:19.099537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:19.124495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002eba1f-814f-4ad4-81e0-4373c9c92803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:19.125115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eba1f-814f-4ad4-81e0-4373c9c92803 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:19.125391 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eba1f-814f-4ad4-81e0-4373c9c92803 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:19.125660 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002eba1f-814f-4ad4-81e0-4373c9c92803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:19.127295 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-002eba1f-814f-4ad4-81e0-4373c9c92803 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:19.236410 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002eba1f-814f-4ad4-81e0-4373c9c92803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:19.237740 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002eba1f-814f-4ad4-81e0-4373c9c92803 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:19.257425 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 736/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:19:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:19:21.229029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815d404-28ef-4679-8b2a-21b6ec27f4cf None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:21.229533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815d404-28ef-4679-8b2a-21b6ec27f4cf None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:21.229659 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815d404-28ef-4679-8b2a-21b6ec27f4cf None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:21.230983 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 720/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:21.236446 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f6e10-6556-4bea-8315-2b02ce4c2c4b None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:21.236833 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f6e10-6556-4bea-8315-2b02ce4c2c4b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:21.236999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f6e10-6556-4bea-8315-2b02ce4c2c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:21.309894 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-b23f6e10-6556-4bea-8315-2b02ce4c2c4b None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:21.311137 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-b23f6e10-6556-4bea-8315-2b02ce4c2c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:21.340476 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:21.408853 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 737/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:19:21.697248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815d404-28ef-4679-8b2a-21b6ec27f4cf None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:21.698834 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5815d404-28ef-4679-8b2a-21b6ec27f4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:21.805348 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815d404-28ef-4679-8b2a-21b6ec27f4cf None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:21.833052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:21.878294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3086e-c623-4a0f-8ae9-db74ca3a0282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:21.878902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3086e-c623-4a0f-8ae9-db74ca3a0282 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:21.879183 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3086e-c623-4a0f-8ae9-db74ca3a0282 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:21.879458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3086e-c623-4a0f-8ae9-db74ca3a0282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:21.881045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-05b3086e-c623-4a0f-8ae9-db74ca3a0282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:21.989347 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3086e-c623-4a0f-8ae9-db74ca3a0282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:21.990790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3086e-c623-4a0f-8ae9-db74ca3a0282 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:22.008959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 721/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:19:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:19:23.977720 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df611c9d-1696-4627-be14-8b3c35db8e0f None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:23.978284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df611c9d-1696-4627-be14-8b3c35db8e0f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:23.978284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df611c9d-1696-4627-be14-8b3c35db8e0f None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:23.979642 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 738/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:23.985137 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f1c38-6ee2-45ce-8f70-e6b6fe4f3631 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:23.985573 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f1c38-6ee2-45ce-8f70-e6b6fe4f3631 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:23.985727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f1c38-6ee2-45ce-8f70-e6b6fe4f3631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:24.052538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f11f1c38-6ee2-45ce-8f70-e6b6fe4f3631 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:24.053741 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f11f1c38-6ee2-45ce-8f70-e6b6fe4f3631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:24.062031 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:24.149727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 722/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:19:24.483518 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df611c9d-1696-4627-be14-8b3c35db8e0f None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:24.485060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-df611c9d-1696-4627-be14-8b3c35db8e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:24.590701 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df611c9d-1696-4627-be14-8b3c35db8e0f None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:24.646467 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:24.666395 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969419e-c433-4f7d-8204-17973c0064f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:24.666997 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969419e-c433-4f7d-8204-17973c0064f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:24.667278 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969419e-c433-4f7d-8204-17973c0064f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:24.667548 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969419e-c433-4f7d-8204-17973c0064f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:24.669169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c969419e-c433-4f7d-8204-17973c0064f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:24.778679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969419e-c433-4f7d-8204-17973c0064f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:24.780465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969419e-c433-4f7d-8204-17973c0064f4 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:24.799750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 739/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:19:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:19:26.794193 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a14c23-fb86-44af-aba0-1f6a554b7a50 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:26.794728 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a14c23-fb86-44af-aba0-1f6a554b7a50 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:26.794728 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a14c23-fb86-44af-aba0-1f6a554b7a50 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:26.796152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 723/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:26.802045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119c837-ef28-4caa-a940-71c1631eb108 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:26.802507 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119c837-ef28-4caa-a940-71c1631eb108 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:26.802633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119c837-ef28-4caa-a940-71c1631eb108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:26.868926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f119c837-ef28-4caa-a940-71c1631eb108 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:26.870050 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f119c837-ef28-4caa-a940-71c1631eb108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:26.908657 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:26.967408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 740/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:19:27.248868 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a14c23-fb86-44af-aba0-1f6a554b7a50 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:27.250495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-76a14c23-fb86-44af-aba0-1f6a554b7a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:27.353862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a14c23-fb86-44af-aba0-1f6a554b7a50 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:27.391391 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:27.428175 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c733daf-49a1-4ff8-a0ec-5eb455f9a750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:27.428777 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c733daf-49a1-4ff8-a0ec-5eb455f9a750 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:27.429056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c733daf-49a1-4ff8-a0ec-5eb455f9a750 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:27.429332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c733daf-49a1-4ff8-a0ec-5eb455f9a750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:27.430988 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6c733daf-49a1-4ff8-a0ec-5eb455f9a750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:27.536799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c733daf-49a1-4ff8-a0ec-5eb455f9a750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:27.538237 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c733daf-49a1-4ff8-a0ec-5eb455f9a750 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:27.556035 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 724/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:19:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:19:29.484189 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c824-6759-4ba2-acfc-5156daac3f1a None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:29.484787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c824-6759-4ba2-acfc-5156daac3f1a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:29.484787 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c824-6759-4ba2-acfc-5156daac3f1a None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:29.485966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 741/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:29.491214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92f887-2f81-4665-8b28-af8418a6dd06 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:29.491683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92f887-2f81-4665-8b28-af8418a6dd06 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:29.491799 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92f887-2f81-4665-8b28-af8418a6dd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:29.559142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4a92f887-2f81-4665-8b28-af8418a6dd06 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:29.560526 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4a92f887-2f81-4665-8b28-af8418a6dd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:29.579998 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:29.662174 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 725/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:19:29.949636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6c824-6759-4ba2-acfc-5156daac3f1a None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:29.951220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-80b6c824-6759-4ba2-acfc-5156daac3f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:30.055343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6c824-6759-4ba2-acfc-5156daac3f1a None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:30.121416 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:30.129101 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e4eb4-f35e-45c7-afdd-0fc4a89d4cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:30.129705 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e4eb4-f35e-45c7-afdd-0fc4a89d4cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:30.129987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e4eb4-f35e-45c7-afdd-0fc4a89d4cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:30.130290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e4eb4-f35e-45c7-afdd-0fc4a89d4cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:30.131889 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c46e4eb4-f35e-45c7-afdd-0fc4a89d4cb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:30.241851 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e4eb4-f35e-45c7-afdd-0fc4a89d4cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:30.243251 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e4eb4-f35e-45c7-afdd-0fc4a89d4cb9 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:30.261648 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 742/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:19:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:19:32.173390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b69651-bef3-412f-8918-44775bc48002 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:32.174000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b69651-bef3-412f-8918-44775bc48002 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:32.174000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b69651-bef3-412f-8918-44775bc48002 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:32.175870 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 726/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:19:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:32.181533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650a8ad-3362-4e87-b429-f193ae95868a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:32.181924 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650a8ad-3362-4e87-b429-f193ae95868a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:32.182107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650a8ad-3362-4e87-b429-f193ae95868a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:32.250556 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-2650a8ad-3362-4e87-b429-f193ae95868a None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:32.251769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-2650a8ad-3362-4e87-b429-f193ae95868a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:32.304857 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:32.353983 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 743/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:19:32.641331 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b69651-bef3-412f-8918-44775bc48002 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:32.642908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-43b69651-bef3-412f-8918-44775bc48002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:32.750197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b69651-bef3-412f-8918-44775bc48002 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:32.798081 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:32.826291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384adde1-d3cf-47c7-be64-2c30981f2d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:32.826898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384adde1-d3cf-47c7-be64-2c30981f2d8f service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:32.827182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384adde1-d3cf-47c7-be64-2c30981f2d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:32.827457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384adde1-d3cf-47c7-be64-2c30981f2d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:32.829057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-384adde1-d3cf-47c7-be64-2c30981f2d8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:32.938095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384adde1-d3cf-47c7-be64-2c30981f2d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:32.939459 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384adde1-d3cf-47c7-be64-2c30981f2d8f service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:32.957866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 727/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:19:42.352138 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=22 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:42.955555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=66 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:52.579672 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cec7e-1da0-44f4-af7c-2a48f86fdc25 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:52.580237 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cec7e-1da0-44f4-af7c-2a48f86fdc25 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:52.580237 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cec7e-1da0-44f4-af7c-2a48f86fdc25 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:52.581563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 744/1471] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:52.587118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e744f-a9de-41c6-81c1-636fb4ff3b06 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:52.587604 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e744f-a9de-41c6-81c1-636fb4ff3b06 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:52.587709 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e744f-a9de-41c6-81c1-636fb4ff3b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:52.652859 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9f3e744f-a9de-41c6-81c1-636fb4ff3b06 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:52.654052 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9f3e744f-a9de-41c6-81c1-636fb4ff3b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:52.751804 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 728/1472] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:19:53.049048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b4509-2449-410c-80cb-cae9b73bf0eb None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:53.049328 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b4509-2449-410c-80cb-cae9b73bf0eb None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:53.049602 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b4509-2449-410c-80cb-cae9b73bf0eb None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:53.052172 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 745/1473] 10.222.0.16 () {54 vars in 967 bytes} [Tue Aug 23 16:19:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:53.057102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5915d4-1b48-467a-b64f-17c507bccc8b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:53.057393 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5915d4-1b48-467a-b64f-17c507bccc8b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:53.057667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5915d4-1b48-467a-b64f-17c507bccc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:53.133127 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ae5915d4-1b48-467a-b64f-17c507bccc8b None None] MFA Rules not processed for user `d3ddab91bbb24d119dd302024f458d35`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:53.134386 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ae5915d4-1b48-467a-b64f-17c507bccc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:53.155076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:53.212565 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 729/1474] 10.222.0.16 () {58 vars in 1064 bytes} [Tue Aug 23 16:19:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:19:53.220140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b4509-2449-410c-80cb-cae9b73bf0eb None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:53.221638 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-228b4509-2449-410c-80cb-cae9b73bf0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:53.325920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b4509-2449-410c-80cb-cae9b73bf0eb None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:53.398137 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4527025-cde7-4817-9ce0-2d9d7f3c120d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3ddab91bbb24d119dd302024f458d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:53.398737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4527025-cde7-4817-9ce0-2d9d7f3c120d service glance] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:53.399016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4527025-cde7-4817-9ce0-2d9d7f3c120d service glance] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:53.399287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4527025-cde7-4817-9ce0-2d9d7f3c120d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:53.401138 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a4527025-cde7-4817-9ce0-2d9d7f3c120d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:53.458901 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:53.514519 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4527025-cde7-4817-9ce0-2d9d7f3c120d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:53.515955 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4527025-cde7-4817-9ce0-2d9d7f3c120d service glance] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:53.535222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 746/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:19:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:19:55.509945 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf2dd5-6fac-4a5a-9a3d-d26592fea3e0 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:55.510516 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf2dd5-6fac-4a5a-9a3d-d26592fea3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:55.510516 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf2dd5-6fac-4a5a-9a3d-d26592fea3e0 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:55.511798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 730/1476] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:55.517201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03ba3a-a98f-4f9a-a140-809a33d366e5 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:55.517626 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03ba3a-a98f-4f9a-a140-809a33d366e5 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:55.517763 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03ba3a-a98f-4f9a-a140-809a33d366e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:55.585536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-da03ba3a-a98f-4f9a-a140-809a33d366e5 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:55.586794 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-da03ba3a-a98f-4f9a-a140-809a33d366e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:55.685955 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 747/1477] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:19:55.963752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf2dd5-6fac-4a5a-9a3d-d26592fea3e0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:55.965349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-eccf2dd5-6fac-4a5a-9a3d-d26592fea3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:56.093098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf2dd5-6fac-4a5a-9a3d-d26592fea3e0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:56.141726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:56.187180 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302b173-e5f5-41f4-813c-7df39bba0895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:56.187786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302b173-e5f5-41f4-813c-7df39bba0895 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:56.188066 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302b173-e5f5-41f4-813c-7df39bba0895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:56.188340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302b173-e5f5-41f4-813c-7df39bba0895 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:56.188973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302b173-e5f5-41f4-813c-7df39bba0895 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:56.191731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: WARNING py.warnings [None req-6302b173-e5f5-41f4-813c-7df39bba0895 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:19:56.191731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: warnings.warn(msg) Aug 23 16:19:56.191731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: Aug 23 16:19:56.192656 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302b173-e5f5-41f4-813c-7df39bba0895 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:56.211403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 731/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 16:19:55 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:19:58.143717 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbf9c6-c2d8-414d-acf7-059d1d1fb3a0 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:58.144958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbf9c6-c2d8-414d-acf7-059d1d1fb3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:58.144958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbf9c6-c2d8-414d-acf7-059d1d1fb3a0 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:58.146232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 748/1479] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:19:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:19:58.151705 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d023205-9b97-442b-90db-1c232f6d30d8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:58.152115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d023205-9b97-442b-90db-1c232f6d30d8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:58.152266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d023205-9b97-442b-90db-1c232f6d30d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:58.219367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2d023205-9b97-442b-90db-1c232f6d30d8 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:19:58.220595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2d023205-9b97-442b-90db-1c232f6d30d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:58.318557 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 732/1480] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:19:58.623699 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbf9c6-c2d8-414d-acf7-059d1d1fb3a0 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:19:58.625192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-3ecbf9c6-c2d8-414d-acf7-059d1d1fb3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:58.635494 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:58.775810 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbf9c6-c2d8-414d-acf7-059d1d1fb3a0 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:19:58.856476 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:19:58.890614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd68b8-2806-48f8-88ba-d3abd887ec38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:19:58.891136 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd68b8-2806-48f8-88ba-d3abd887ec38 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:19:58.891412 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd68b8-2806-48f8-88ba-d3abd887ec38 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:19:58.891681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd68b8-2806-48f8-88ba-d3abd887ec38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:19:58.893301 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-fcbd68b8-2806-48f8-88ba-d3abd887ec38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:19:58.983682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd68b8-2806-48f8-88ba-d3abd887ec38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:19:58.985260 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd68b8-2806-48f8-88ba-d3abd887ec38 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:19:59.005018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 749/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:19:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:20:01.132304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fba78-8b1f-49e8-a971-bf15112ff2d7 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:01.132902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fba78-8b1f-49e8-a971-bf15112ff2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:01.132902 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fba78-8b1f-49e8-a971-bf15112ff2d7 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:01.134246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 733/1482] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:20:01.139431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8eeeed-ecc7-4ac6-9657-fecb2db1c5df None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:01.139880 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8eeeed-ecc7-4ac6-9657-fecb2db1c5df None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:01.140002 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8eeeed-ecc7-4ac6-9657-fecb2db1c5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:01.207265 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-5e8eeeed-ecc7-4ac6-9657-fecb2db1c5df None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:20:01.208484 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-5e8eeeed-ecc7-4ac6-9657-fecb2db1c5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:01.254640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:01.306421 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 750/1483] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:20:01.589226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fba78-8b1f-49e8-a971-bf15112ff2d7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:01.590808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-858fba78-8b1f-49e8-a971-bf15112ff2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:01.613987 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:01.695504 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fba78-8b1f-49e8-a971-bf15112ff2d7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:01.768664 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4cebc6-9410-4d2e-886a-f1483563426e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:01.769852 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cebc6-9410-4d2e-886a-f1483563426e service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:01.770259 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cebc6-9410-4d2e-886a-f1483563426e service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:01.770540 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4cebc6-9410-4d2e-886a-f1483563426e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:01.772148 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dd4cebc6-9410-4d2e-886a-f1483563426e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:01.845373 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:01.880140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cebc6-9410-4d2e-886a-f1483563426e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:01.881568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4cebc6-9410-4d2e-886a-f1483563426e service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:01.899684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 734/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:20:03.859229 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b831d-fa57-454c-9360-f1f5dd007271 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:03.859785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b831d-fa57-454c-9360-f1f5dd007271 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:03.859785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b831d-fa57-454c-9360-f1f5dd007271 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:03.861077 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 751/1485] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:20:03.867123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee2742-1998-4fa7-b737-9f0e08821696 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:03.867533 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee2742-1998-4fa7-b737-9f0e08821696 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:03.867672 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee2742-1998-4fa7-b737-9f0e08821696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:03.933645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7fee2742-1998-4fa7-b737-9f0e08821696 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:20:03.934862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7fee2742-1998-4fa7-b737-9f0e08821696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:04.032827 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 735/1486] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:20:04.321189 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b831d-fa57-454c-9360-f1f5dd007271 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:04.322766 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1d2b831d-fa57-454c-9360-f1f5dd007271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:04.426551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b831d-fa57-454c-9360-f1f5dd007271 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:04.504914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:04.506881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2c201-c2c2-45b8-8292-181cd4039967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:04.507548 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2c201-c2c2-45b8-8292-181cd4039967 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:04.508072 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2c201-c2c2-45b8-8292-181cd4039967 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:04.508506 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2c201-c2c2-45b8-8292-181cd4039967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:04.510365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-20d2c201-c2c2-45b8-8292-181cd4039967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:04.622331 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2c201-c2c2-45b8-8292-181cd4039967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:04.623778 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2c201-c2c2-45b8-8292-181cd4039967 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:04.641723 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 752/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:20:06.735796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fe60f-ec49-4886-b246-0536b448b80b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:06.736370 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fe60f-ec49-4886-b246-0536b448b80b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:06.736370 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fe60f-ec49-4886-b246-0536b448b80b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:06.737706 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 736/1488] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:20:06.743449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7be6b-96cf-40e6-abaa-4190d1eaddcd None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:06.743913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7be6b-96cf-40e6-abaa-4190d1eaddcd None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:06.744019 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7be6b-96cf-40e6-abaa-4190d1eaddcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:06.810911 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-13e7be6b-96cf-40e6-abaa-4190d1eaddcd None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:20:06.812122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-13e7be6b-96cf-40e6-abaa-4190d1eaddcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:06.865320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:06.909046 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 753/1489] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:20:07.201453 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fe60f-ec49-4886-b246-0536b448b80b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:07.203171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5c0fe60f-ec49-4886-b246-0536b448b80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:07.361338 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:07.428992 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fe60f-ec49-4886-b246-0536b448b80b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:07.499636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b5bc8-b0d2-47ed-996c-ab21ea33f866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:07.500162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b5bc8-b0d2-47ed-996c-ab21ea33f866 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:07.500441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b5bc8-b0d2-47ed-996c-ab21ea33f866 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:07.500713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b5bc8-b0d2-47ed-996c-ab21ea33f866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:07.502323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-259b5bc8-b0d2-47ed-996c-ab21ea33f866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:07.587322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:07.616093 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b5bc8-b0d2-47ed-996c-ab21ea33f866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:07.617516 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b5bc8-b0d2-47ed-996c-ab21ea33f866 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:07.635608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 737/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:20:09.741588 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d6f86-e82a-4984-a6c4-0f8f759ee9af None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:09.742154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d6f86-e82a-4984-a6c4-0f8f759ee9af None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:09.742257 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d6f86-e82a-4984-a6c4-0f8f759ee9af None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:09.743560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 754/1491] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 16:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:20:09.748916 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59273577-2564-434d-afa7-73c1a4ac768c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:09.749366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59273577-2564-434d-afa7-73c1a4ac768c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:09.749481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59273577-2564-434d-afa7-73c1a4ac768c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:09.814876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-59273577-2564-434d-afa7-73c1a4ac768c None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:20:09.816072 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-59273577-2564-434d-afa7-73c1a4ac768c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:09.912246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 738/1492] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 16:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:20:10.204818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d6f86-e82a-4984-a6c4-0f8f759ee9af None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:20:10.206371 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-918d6f86-e82a-4984-a6c4-0f8f759ee9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:10.308309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d6f86-e82a-4984-a6c4-0f8f759ee9af None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:20:10.381998 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff58104-17d4-4204-b2e1-13ba7d606958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:20:10.382640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff58104-17d4-4204-b2e1-13ba7d606958 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:20:10.382922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff58104-17d4-4204-b2e1-13ba7d606958 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:20:10.383194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff58104-17d4-4204-b2e1-13ba7d606958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:20:10.384796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-fff58104-17d4-4204-b2e1-13ba7d606958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:20:10.393905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:10.495019 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff58104-17d4-4204-b2e1-13ba7d606958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:20:10.496379 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff58104-17d4-4204-b2e1-13ba7d606958 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:20:10.515152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 755/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:20:19.910487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=82 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:20:20.512925 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=50 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:21:31.742663 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac837aee-1409-4809-803c-224df3a2333f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:31.743258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac837aee-1409-4809-803c-224df3a2333f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:31.743258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac837aee-1409-4809-803c-224df3a2333f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:31.819757 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ac837aee-1409-4809-803c-224df3a2333f None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:21:31.820973 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ac837aee-1409-4809-803c-224df3a2333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:31.920518 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 739/1494] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:21:31.928609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356a0b2-093d-4980-aec3-08ff62bc266e None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:31.929131 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356a0b2-093d-4980-aec3-08ff62bc266e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:31.929131 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356a0b2-093d-4980-aec3-08ff62bc266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:32.008900 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f356a0b2-093d-4980-aec3-08ff62bc266e None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:21:32.010134 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f356a0b2-093d-4980-aec3-08ff62bc266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:32.107337 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 756/1495] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:21:32.112044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac837aee-1409-4809-803c-224df3a2333f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:32.113251 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ac837aee-1409-4809-803c-224df3a2333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:32.125029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac837aee-1409-4809-803c-224df3a2333f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:32.186025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:21:32.220715 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45174629-a09a-472d-a3ec-a3126970e1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:32.221322 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45174629-a09a-472d-a3ec-a3126970e1de admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:32.221602 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45174629-a09a-472d-a3ec-a3126970e1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:32.221870 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45174629-a09a-472d-a3ec-a3126970e1de admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:32.222537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45174629-a09a-472d-a3ec-a3126970e1de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:21:32.222837 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45174629-a09a-472d-a3ec-a3126970e1de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:32.223835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: WARNING py.warnings [None req-45174629-a09a-472d-a3ec-a3126970e1de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:21:32.223835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: warnings.warn(msg) Aug 23 16:21:32.223835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: Aug 23 16:21:32.225325 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45174629-a09a-472d-a3ec-a3126970e1de admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:32.236429 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 740/1496] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 23 16:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:21:32.244832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356a0b2-093d-4980-aec3-08ff62bc266e None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:32.254621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356a0b2-093d-4980-aec3-08ff62bc266e None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:32.316992 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:21:32.353219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986272f0-9734-450d-9702-0703e890256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:32.353820 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986272f0-9734-450d-9702-0703e890256b admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:32.354125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986272f0-9734-450d-9702-0703e890256b admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:32.354400 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986272f0-9734-450d-9702-0703e890256b admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:32.355029 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986272f0-9734-450d-9702-0703e890256b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:32.356826 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: WARNING py.warnings [None req-986272f0-9734-450d-9702-0703e890256b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:21:32.356826 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: warnings.warn(msg) Aug 23 16:21:32.356826 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: Aug 23 16:21:32.358044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986272f0-9734-450d-9702-0703e890256b admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:32.414777 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 757/1497] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 23 16:21:32 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:21:32.418995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45174629-a09a-472d-a3ec-a3126970e1de admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:32.420593 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-45174629-a09a-472d-a3ec-a3126970e1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:32.454048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45174629-a09a-472d-a3ec-a3126970e1de admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:32.546898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b9722-902e-4e5d-a133-99cb40075c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:32.547511 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b9722-902e-4e5d-a133-99cb40075c22 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:32.547790 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b9722-902e-4e5d-a133-99cb40075c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:32.548060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b9722-902e-4e5d-a133-99cb40075c22 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:32.548689 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b9722-902e-4e5d-a133-99cb40075c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:32.549694 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: WARNING py.warnings [None req-269b9722-902e-4e5d-a133-99cb40075c22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:21:32.549694 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: warnings.warn(msg) Aug 23 16:21:32.549694 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: Aug 23 16:21:32.550943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b9722-902e-4e5d-a133-99cb40075c22 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:32.600737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 741/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 16:21:32 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:21:32.605146 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986272f0-9734-450d-9702-0703e890256b admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:32.606726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-986272f0-9734-450d-9702-0703e890256b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:32.675185 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986272f0-9734-450d-9702-0703e890256b admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:32.764158 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:21:32.775518 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d296096-e1fb-4603-bdd2-4b1ff1840421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:32.776118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d296096-e1fb-4603-bdd2-4b1ff1840421 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:32.776392 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d296096-e1fb-4603-bdd2-4b1ff1840421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:32.776659 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d296096-e1fb-4603-bdd2-4b1ff1840421 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:32.777291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d296096-e1fb-4603-bdd2-4b1ff1840421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:32.778326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: WARNING py.warnings [None req-1d296096-e1fb-4603-bdd2-4b1ff1840421 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:21:32.778326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: warnings.warn(msg) Aug 23 16:21:32.778326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: Aug 23 16:21:32.779491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d296096-e1fb-4603-bdd2-4b1ff1840421 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:32.791780 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 758/1499] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 23 16:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:21:32.796872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b9722-902e-4e5d-a133-99cb40075c22 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:32.798420 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-269b9722-902e-4e5d-a133-99cb40075c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:32.810594 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b9722-902e-4e5d-a133-99cb40075c22 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:32.835775 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:21:32.907762 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8030bb2-0499-4eb9-9baa-bdd370544f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:32.908801 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8030bb2-0499-4eb9-9baa-bdd370544f57 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:32.909125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8030bb2-0499-4eb9-9baa-bdd370544f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:32.909399 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8030bb2-0499-4eb9-9baa-bdd370544f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:32.910044 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8030bb2-0499-4eb9-9baa-bdd370544f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:32.911390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: WARNING py.warnings [None req-c8030bb2-0499-4eb9-9baa-bdd370544f57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:21:32.911390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: warnings.warn(msg) Aug 23 16:21:32.911390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: Aug 23 16:21:32.912539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8030bb2-0499-4eb9-9baa-bdd370544f57 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:32.932884 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 742/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 23 16:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:21:32.938544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d296096-e1fb-4603-bdd2-4b1ff1840421 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:32.940097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1d296096-e1fb-4603-bdd2-4b1ff1840421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:32.973457 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d296096-e1fb-4603-bdd2-4b1ff1840421 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:33.067641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a563d-bc34-48b4-8f2d-64e3aab2c513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:33.068329 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a563d-bc34-48b4-8f2d-64e3aab2c513 admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:33.068610 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a563d-bc34-48b4-8f2d-64e3aab2c513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:33.068888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a563d-bc34-48b4-8f2d-64e3aab2c513 admin admin] PATH_INFO: `/v3/projects/6b0cebc7776347b885a956ec986880cc/users/d2a564a10ad44012a0458b878ae5b406/roles/8e4aa52bcd2a47389ee1c5de44fa28ca` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:33.090202 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a563d-bc34-48b4-8f2d-64e3aab2c513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b0cebc7776347b885a956ec986880cc, user_id=d2a564a10ad44012a0458b878ae5b406, role_id=8e4aa52bcd2a47389ee1c5de44fa28ca)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:33.091226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: WARNING py.warnings [None req-428a563d-bc34-48b4-8f2d-64e3aab2c513 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:21:33.091226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: warnings.warn(msg) Aug 23 16:21:33.091226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: Aug 23 16:21:33.093165 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a563d-bc34-48b4-8f2d-64e3aab2c513 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:33.117495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 759/1501] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 23 16:21:32 2022] PUT /identity/v3/projects/6b0cebc7776347b885a956ec986880cc/users/d2a564a10ad44012a0458b878ae5b406/roles/8e4aa52bcd2a47389ee1c5de44fa28ca => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:21:33.129649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd43c44-7ace-48de-acad-beaedc360c88 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:33.129940 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd43c44-7ace-48de-acad-beaedc360c88 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:33.130248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd43c44-7ace-48de-acad-beaedc360c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:33.187326 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8bd43c44-7ace-48de-acad-beaedc360c88 None None] MFA Rules not processed for user `d2a564a10ad44012a0458b878ae5b406`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:21:33.188542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8bd43c44-7ace-48de-acad-beaedc360c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:33.266299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 743/1502] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:21:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:21:33.280073 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040a1bd-f56f-4054-9702-53e4efdf26c4 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:33.280365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040a1bd-f56f-4054-9702-53e4efdf26c4 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:33.280644 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040a1bd-f56f-4054-9702-53e4efdf26c4 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:33.281971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 760/1503] 10.222.0.16 () {54 vars in 964 bytes} [Tue Aug 23 16:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:21:33.288000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4afcfa-c144-4030-8d5a-f5efb49be574 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:33.288290 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4afcfa-c144-4030-8d5a-f5efb49be574 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:33.288561 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4afcfa-c144-4030-8d5a-f5efb49be574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:33.320702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:21:33.364518 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ba4afcfa-c144-4030-8d5a-f5efb49be574 None None] MFA Rules not processed for user `8ffa4002b4b24e6e9665dc349ad2f1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:21:33.366368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ba4afcfa-c144-4030-8d5a-f5efb49be574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:33.441440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 744/1504] 10.222.0.16 () {58 vars in 1061 bytes} [Tue Aug 23 16:21:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:21:33.449910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040a1bd-f56f-4054-9702-53e4efdf26c4 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:33.451456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f040a1bd-f56f-4054-9702-53e4efdf26c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:33.500651 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:21:33.556672 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040a1bd-f56f-4054-9702-53e4efdf26c4 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:33.632008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9a110-a540-478d-8029-131c1c3fa7ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ffa4002b4b24e6e9665dc349ad2f1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:33.632538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9a110-a540-478d-8029-131c1c3fa7ac service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:33.632818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9a110-a540-478d-8029-131c1c3fa7ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:33.633088 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9a110-a540-478d-8029-131c1c3fa7ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:33.634732 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7eb9a110-a540-478d-8029-131c1c3fa7ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:33.732807 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9a110-a540-478d-8029-131c1c3fa7ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:33.734273 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9a110-a540-478d-8029-131c1c3fa7ac service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:33.737684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:21:33.752498 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 761/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:21:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:21:33.797656 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb7309-b85a-4605-aed8-de35ef840c8d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:33.798143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb7309-b85a-4605-aed8-de35ef840c8d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:33.798251 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb7309-b85a-4605-aed8-de35ef840c8d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:33.799485 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 745/1506] 10.222.0.16 () {52 vars in 830 bytes} [Tue Aug 23 16:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:21:33.803781 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9a110-a540-478d-8029-131c1c3fa7ac service cinder] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:33.805023 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7eb9a110-a540-478d-8029-131c1c3fa7ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:33.905208 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9a110-a540-478d-8029-131c1c3fa7ac service cinder] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:34.118642 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731159a6-c5ab-4a02-889e-91d9f3430213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:34.119323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731159a6-c5ab-4a02-889e-91d9f3430213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:34.119547 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731159a6-c5ab-4a02-889e-91d9f3430213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:34.119816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731159a6-c5ab-4a02-889e-91d9f3430213 admin admin] PATH_INFO: `/v3/users/d2a564a10ad44012a0458b878ae5b406` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:34.131887 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731159a6-c5ab-4a02-889e-91d9f3430213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2a564a10ad44012a0458b878ae5b406)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:34.132921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: WARNING py.warnings [None req-731159a6-c5ab-4a02-889e-91d9f3430213 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:21:34.132921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: warnings.warn(msg) Aug 23 16:21:34.132921 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: Aug 23 16:21:34.134418 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731159a6-c5ab-4a02-889e-91d9f3430213 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:34.143858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:21:34.207698 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-731159a6-c5ab-4a02-889e-91d9f3430213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2a564a10ad44012a0458b878ae5b406'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:21:34.217645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-731159a6-c5ab-4a02-889e-91d9f3430213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2a564a10ad44012a0458b878ae5b406'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:21:34.218191 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-731159a6-c5ab-4a02-889e-91d9f3430213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2a564a10ad44012a0458b878ae5b406'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:21:34.233069 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-731159a6-c5ab-4a02-889e-91d9f3430213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2a564a10ad44012a0458b878ae5b406'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:21:34.255289 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-731159a6-c5ab-4a02-889e-91d9f3430213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2a564a10ad44012a0458b878ae5b406'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:21:34.260950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 762/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 23 16:21:33 2022] DELETE /identity/v3/users/d2a564a10ad44012a0458b878ae5b406 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:21:34.265362 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e12e13-91a9-4cd0-a6a9-83a386bb723a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:34.265651 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e12e13-91a9-4cd0-a6a9-83a386bb723a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:34.265924 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e12e13-91a9-4cd0-a6a9-83a386bb723a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:34.323257 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f4e12e13-91a9-4cd0-a6a9-83a386bb723a None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:21:34.324518 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f4e12e13-91a9-4cd0-a6a9-83a386bb723a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:34.401781 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:21:34.415671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 746/1508] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:21:34.425194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731159a6-c5ab-4a02-889e-91d9f3430213 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:34.426481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-731159a6-c5ab-4a02-889e-91d9f3430213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:34.527383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731159a6-c5ab-4a02-889e-91d9f3430213 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:34.584696 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:21:34.605693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39284ee6-4dd6-4b27-886b-bed246668268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:34.606329 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39284ee6-4dd6-4b27-886b-bed246668268 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:34.606606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39284ee6-4dd6-4b27-886b-bed246668268 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:34.606872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39284ee6-4dd6-4b27-886b-bed246668268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:34.608451 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-39284ee6-4dd6-4b27-886b-bed246668268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:34.717518 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39284ee6-4dd6-4b27-886b-bed246668268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:34.718887 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39284ee6-4dd6-4b27-886b-bed246668268 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:34.737075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 763/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:21:35.092065 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e12e13-91a9-4cd0-a6a9-83a386bb723a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:21:35.093353 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f4e12e13-91a9-4cd0-a6a9-83a386bb723a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:21:35.105311 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e12e13-91a9-4cd0-a6a9-83a386bb723a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:21:35.204281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be385060-5aac-455a-983a-e199b92525cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:21:35.204910 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be385060-5aac-455a-983a-e199b92525cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:21:35.205187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be385060-5aac-455a-983a-e199b92525cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:21:35.205455 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be385060-5aac-455a-983a-e199b92525cb admin admin] PATH_INFO: `/v3/projects/6b0cebc7776347b885a956ec986880cc` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:21:35.215141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be385060-5aac-455a-983a-e199b92525cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b0cebc7776347b885a956ec986880cc)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:21:35.216153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: WARNING py.warnings [None req-be385060-5aac-455a-983a-e199b92525cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:21:35.216153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: warnings.warn(msg) Aug 23 16:21:35.216153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: Aug 23 16:21:35.217342 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be385060-5aac-455a-983a-e199b92525cb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:21:35.274597 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-be385060-5aac-455a-983a-e199b92525cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b0cebc7776347b885a956ec986880cc', 'request_id': 'req-be385060-5aac-455a-983a-e199b92525cb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:21:35.288188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-be385060-5aac-455a-983a-e199b92525cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b0cebc7776347b885a956ec986880cc', 'request_id': 'req-be385060-5aac-455a-983a-e199b92525cb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:21:35.294096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-be385060-5aac-455a-983a-e199b92525cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b0cebc7776347b885a956ec986880cc', 'request_id': 'req-be385060-5aac-455a-983a-e199b92525cb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:21:35.320314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-be385060-5aac-455a-983a-e199b92525cb admin admin] The token cache is being invalidate because project 6b0cebc7776347b885a956ec986880cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:21:35.320606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-be385060-5aac-455a-983a-e199b92525cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:21:35.321026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-be385060-5aac-455a-983a-e199b92525cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:21:35.322441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 747/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 23 16:21:35 2022] DELETE /identity/v3/projects/6b0cebc7776347b885a956ec986880cc => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:21:44.734822 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=62 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:21:45.317588 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:22:57.292705 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1c7f1-188b-4c8a-8aa0-b8748e19d834 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:57.293320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1c7f1-188b-4c8a-8aa0-b8748e19d834 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:57.293320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1c7f1-188b-4c8a-8aa0-b8748e19d834 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:57.294613 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 764/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:22:57.299378 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83cf05-90ca-4dad-835e-639d4779d7c9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:57.299833 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83cf05-90ca-4dad-835e-639d4779d7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:57.299943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83cf05-90ca-4dad-835e-639d4779d7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:57.381375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5d83cf05-90ca-4dad-835e-639d4779d7c9 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:22:57.382625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5d83cf05-90ca-4dad-835e-639d4779d7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:22:57.486034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 748/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:22:57.642722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1c7f1-188b-4c8a-8aa0-b8748e19d834 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:57.644806 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4cc1c7f1-188b-4c8a-8aa0-b8748e19d834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:22:57.763455 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1c7f1-188b-4c8a-8aa0-b8748e19d834 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:57.768786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22520a25-575d-462d-a573-eca9ff2930ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:57.769382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22520a25-575d-462d-a573-eca9ff2930ee service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:57.769661 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22520a25-575d-462d-a573-eca9ff2930ee service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:57.769929 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22520a25-575d-462d-a573-eca9ff2930ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:57.778439 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22520a25-575d-462d-a573-eca9ff2930ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:57.780000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22520a25-575d-462d-a573-eca9ff2930ee service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:57.789607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 765/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:22:58.631544 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429944b-8794-4efd-b708-d0233d7d11c6 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:58.632169 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429944b-8794-4efd-b708-d0233d7d11c6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:58.632277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429944b-8794-4efd-b708-d0233d7d11c6 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:58.633614 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 749/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:22:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:22:58.638633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ab654-16e7-40b0-9dea-cfd42b9ead6c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:58.639099 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ab654-16e7-40b0-9dea-cfd42b9ead6c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:58.639216 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ab654-16e7-40b0-9dea-cfd42b9ead6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:58.659543 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-689ab654-16e7-40b0-9dea-cfd42b9ead6c None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:22:58.660750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-689ab654-16e7-40b0-9dea-cfd42b9ead6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:22:58.668620 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 766/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:22:58.822551 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429944b-8794-4efd-b708-d0233d7d11c6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:22:58.837485 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429944b-8794-4efd-b708-d0233d7d11c6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:22:58.842860 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053b8b9-a826-4339-9bfd-85547ca39976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:22:58.843465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053b8b9-a826-4339-9bfd-85547ca39976 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:22:58.843750 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053b8b9-a826-4339-9bfd-85547ca39976 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:22:58.844024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053b8b9-a826-4339-9bfd-85547ca39976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:22:58.852312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053b8b9-a826-4339-9bfd-85547ca39976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:22:58.853943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053b8b9-a826-4339-9bfd-85547ca39976 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:22:58.863615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 750/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:23:01.712281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2689ec7-7396-4478-86c4-a787931c82ba None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:01.712819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2689ec7-7396-4478-86c4-a787931c82ba None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:01.712819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2689ec7-7396-4478-86c4-a787931c82ba None None] PATH_INFO: `/v3` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:01.714130 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 767/1517] 10.222.0.60 () {54 vars in 925 bytes} [Tue Aug 23 16:23:01 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 16:23:01.726288 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2498e-27bc-40e5-a61f-600d0a93aa29 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:01.726872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2498e-27bc-40e5-a61f-600d0a93aa29 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:01.727128 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2498e-27bc-40e5-a61f-600d0a93aa29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:01.792738 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8eb2498e-27bc-40e5-a61f-600d0a93aa29 None None] MFA Rules not processed for user `9cd1309c315e49eea6af4691d14c3e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:23:01.793977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8eb2498e-27bc-40e5-a61f-600d0a93aa29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:23:01.811963 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:23:01.868742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 751/1518] 10.222.0.60 () {58 vars in 1015 bytes} [Tue Aug 23 16:23:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:23:05.743653 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec9b51-95da-41bb-a3d9-f83ba49bbe76 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:05.744215 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec9b51-95da-41bb-a3d9-f83ba49bbe76 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:05.744215 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec9b51-95da-41bb-a3d9-f83ba49bbe76 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:05.745447 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 768/1519] 10.222.0.16 () {54 vars in 961 bytes} [Tue Aug 23 16:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:23:05.750774 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3606c2-8a35-42f9-aed2-22b3cc56832a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:05.751220 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3606c2-8a35-42f9-aed2-22b3cc56832a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:05.751333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3606c2-8a35-42f9-aed2-22b3cc56832a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:05.770854 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2a3606c2-8a35-42f9-aed2-22b3cc56832a None None] MFA Rules not processed for user `9cd1309c315e49eea6af4691d14c3e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:23:05.772068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2a3606c2-8a35-42f9-aed2-22b3cc56832a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:23:05.780719 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 752/1520] 10.222.0.16 () {58 vars in 1058 bytes} [Tue Aug 23 16:23:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:23:05.788142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec9b51-95da-41bb-a3d9-f83ba49bbe76 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:23:05.801266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec9b51-95da-41bb-a3d9-f83ba49bbe76 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:23:05.806726 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e023663-cc31-46ae-b9b0-0013d8613be5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd1309c315e49eea6af4691d14c3e90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:23:05.807302 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e023663-cc31-46ae-b9b0-0013d8613be5 service placement] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:05.807577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e023663-cc31-46ae-b9b0-0013d8613be5 service placement] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:05.807846 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e023663-cc31-46ae-b9b0-0013d8613be5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:05.815843 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e023663-cc31-46ae-b9b0-0013d8613be5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:23:05.817398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e023663-cc31-46ae-b9b0-0013d8613be5 service placement] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:23:05.827618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 769/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:23:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:23:10.114355 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ac479-2d7b-4fcd-948b-3dcca9f7fb51 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:10.114943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ac479-2d7b-4fcd-948b-3dcca9f7fb51 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:10.114943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ac479-2d7b-4fcd-948b-3dcca9f7fb51 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:10.116247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 753/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:23:10.121497 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b865d77-d37b-4933-b0b3-4d46794e1ea7 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:10.121889 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b865d77-d37b-4933-b0b3-4d46794e1ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:10.122038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b865d77-d37b-4933-b0b3-4d46794e1ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:10.141381 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-7b865d77-d37b-4933-b0b3-4d46794e1ea7 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:23:10.142630 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7b865d77-d37b-4933-b0b3-4d46794e1ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:23:10.151419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 770/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:23:10.306020 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ac479-2d7b-4fcd-948b-3dcca9f7fb51 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:23:10.320477 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ac479-2d7b-4fcd-948b-3dcca9f7fb51 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:23:10.326640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626ed03-d8fa-4186-b838-bd0d49033083 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:23:10.327235 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626ed03-d8fa-4186-b838-bd0d49033083 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:10.327515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626ed03-d8fa-4186-b838-bd0d49033083 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:10.327791 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626ed03-d8fa-4186-b838-bd0d49033083 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:10.335807 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626ed03-d8fa-4186-b838-bd0d49033083 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:23:10.337815 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626ed03-d8fa-4186-b838-bd0d49033083 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:23:10.347194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 754/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:23:11.173584 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f10b7-806b-47cb-bf6f-2148e1cd3141 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:11.174173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f10b7-806b-47cb-bf6f-2148e1cd3141 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:11.174173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f10b7-806b-47cb-bf6f-2148e1cd3141 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:11.175490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 771/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 16:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:23:11.181458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc37b55-4caa-4548-903f-37e6d72670cb None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:11.181869 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc37b55-4caa-4548-903f-37e6d72670cb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:11.182012 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc37b55-4caa-4548-903f-37e6d72670cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:11.201214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fdc37b55-4caa-4548-903f-37e6d72670cb None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:23:11.202747 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fdc37b55-4caa-4548-903f-37e6d72670cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:23:11.210495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 755/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 16:23:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:23:11.363102 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f10b7-806b-47cb-bf6f-2148e1cd3141 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:23:11.378300 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f10b7-806b-47cb-bf6f-2148e1cd3141 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:23:11.387708 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f40d36-1045-4b5c-8a57-8bfb2a280b02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:23:11.388308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f40d36-1045-4b5c-8a57-8bfb2a280b02 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:11.388592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f40d36-1045-4b5c-8a57-8bfb2a280b02 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:11.388867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f40d36-1045-4b5c-8a57-8bfb2a280b02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:11.399224 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f40d36-1045-4b5c-8a57-8bfb2a280b02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:23:11.400993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f40d36-1045-4b5c-8a57-8bfb2a280b02 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:23:11.410928 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 772/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:23:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:23:15.416963 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc8bce-329a-4f65-bd0d-6d2e218a88a1 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:15.417493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc8bce-329a-4f65-bd0d-6d2e218a88a1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:15.417493 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc8bce-329a-4f65-bd0d-6d2e218a88a1 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:15.418865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 756/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:23:15.423979 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9746f-d215-4704-b128-25eb17cc26dd None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:15.424433 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9746f-d215-4704-b128-25eb17cc26dd None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:15.424536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9746f-d215-4704-b128-25eb17cc26dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:15.444237 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-45a9746f-d215-4704-b128-25eb17cc26dd None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:23:15.445344 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-45a9746f-d215-4704-b128-25eb17cc26dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:23:15.453870 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 773/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:23:15.750209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc8bce-329a-4f65-bd0d-6d2e218a88a1 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:23:15.751918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8fcc8bce-329a-4f65-bd0d-6d2e218a88a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:23:15.829213 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc8bce-329a-4f65-bd0d-6d2e218a88a1 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:23:15.832758 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89501737-7975-4b88-91db-417d7b51ab47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:23:15.833358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89501737-7975-4b88-91db-417d7b51ab47 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:15.833640 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89501737-7975-4b88-91db-417d7b51ab47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:15.833915 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89501737-7975-4b88-91db-417d7b51ab47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:15.843442 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89501737-7975-4b88-91db-417d7b51ab47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:23:15.844861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89501737-7975-4b88-91db-417d7b51ab47 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:23:15.854935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 757/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:23:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:23:17.786195 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51387405-c27a-4767-843c-5366d5292ba1 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:17.786797 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51387405-c27a-4767-843c-5366d5292ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:17.786797 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51387405-c27a-4767-843c-5366d5292ba1 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:17.788086 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 774/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:23:17.793867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae059d9-8ec5-49f2-882c-6d695508bf7d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:17.794319 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae059d9-8ec5-49f2-882c-6d695508bf7d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:17.794463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae059d9-8ec5-49f2-882c-6d695508bf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:17.814263 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2ae059d9-8ec5-49f2-882c-6d695508bf7d None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:23:17.815463 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2ae059d9-8ec5-49f2-882c-6d695508bf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:23:17.824287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 758/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:23:18.111050 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51387405-c27a-4767-843c-5366d5292ba1 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:23:18.122523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51387405-c27a-4767-843c-5366d5292ba1 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:23:18.125966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970c663-fda1-4d0f-ae62-99a1df0645ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:23:18.126577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970c663-fda1-4d0f-ae62-99a1df0645ac service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:18.126859 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970c663-fda1-4d0f-ae62-99a1df0645ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:18.127131 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970c663-fda1-4d0f-ae62-99a1df0645ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:18.135786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970c663-fda1-4d0f-ae62-99a1df0645ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:23:18.137212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970c663-fda1-4d0f-ae62-99a1df0645ac service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:23:18.146383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 775/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:23:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:23:21.537159 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f39ba0-708a-4b80-b995-2dfaed120cd7 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:21.537677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f39ba0-708a-4b80-b995-2dfaed120cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:21.537677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f39ba0-708a-4b80-b995-2dfaed120cd7 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:21.539008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 759/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:23:21.544526 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790c36e-c746-46f8-ac64-da5f49231817 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:21.544945 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790c36e-c746-46f8-ac64-da5f49231817 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:21.545072 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790c36e-c746-46f8-ac64-da5f49231817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:21.564996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-7790c36e-c746-46f8-ac64-da5f49231817 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:23:21.566228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-7790c36e-c746-46f8-ac64-da5f49231817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:23:21.574793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 776/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:23:22.136266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f39ba0-708a-4b80-b995-2dfaed120cd7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:23:22.137922 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b8f39ba0-708a-4b80-b995-2dfaed120cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:23:22.205168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:23:22.219419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f39ba0-708a-4b80-b995-2dfaed120cd7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:23:22.223034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cee451-8d1f-48f1-bca5-9465a7413094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ffa4002b4b24e6e9665dc349ad2f1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:23:22.223668 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cee451-8d1f-48f1-bca5-9465a7413094 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:22.223950 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cee451-8d1f-48f1-bca5-9465a7413094 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:22.224225 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cee451-8d1f-48f1-bca5-9465a7413094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:22.233043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cee451-8d1f-48f1-bca5-9465a7413094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:23:22.234511 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cee451-8d1f-48f1-bca5-9465a7413094 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:23:22.244170 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 760/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:23:24.155962 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbebd86-6302-46b7-8bf2-c5bd46b81770 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:24.156574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbebd86-6302-46b7-8bf2-c5bd46b81770 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:24.156574 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbebd86-6302-46b7-8bf2-c5bd46b81770 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:24.157915 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 777/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 16:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:23:24.163209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd24db-c1d7-4a6d-a21a-0a7c292d85c6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:24.163637 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd24db-c1d7-4a6d-a21a-0a7c292d85c6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:24.163759 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd24db-c1d7-4a6d-a21a-0a7c292d85c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:24.183107 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e9fd24db-c1d7-4a6d-a21a-0a7c292d85c6 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:23:24.184308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e9fd24db-c1d7-4a6d-a21a-0a7c292d85c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:23:24.192168 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 761/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 16:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:23:24.741114 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbebd86-6302-46b7-8bf2-c5bd46b81770 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:23:24.743569 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6dbebd86-6302-46b7-8bf2-c5bd46b81770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:23:24.751103 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=84 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:23:24.757505 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbebd86-6302-46b7-8bf2-c5bd46b81770 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:23:24.761178 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f9304-30c1-4d1d-8f9f-490934a76da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ffa4002b4b24e6e9665dc349ad2f1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:23:24.761769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f9304-30c1-4d1d-8f9f-490934a76da5 service cinder] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:23:24.762048 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f9304-30c1-4d1d-8f9f-490934a76da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:23:24.762349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f9304-30c1-4d1d-8f9f-490934a76da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:23:24.771229 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f9304-30c1-4d1d-8f9f-490934a76da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:23:24.772643 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f9304-30c1-4d1d-8f9f-490934a76da5 service cinder] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:23:24.782874 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 778/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:23:34.178264 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=11 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:23:34.778440 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=5 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:42.720284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d15b7-728d-43de-ad35-bb11b410e120 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:42.720882 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d15b7-728d-43de-ad35-bb11b410e120 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:42.720996 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d15b7-728d-43de-ad35-bb11b410e120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:42.740282 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d73d15b7-728d-43de-ad35-bb11b410e120 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:42.741495 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d73d15b7-728d-43de-ad35-bb11b410e120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:42.746203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3815b27-9ebb-480e-9d4f-d38f593db508 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:42.746684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3815b27-9ebb-480e-9d4f-d38f593db508 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:42.746776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3815b27-9ebb-480e-9d4f-d38f593db508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:42.749626 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 762/1540] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:24:42.757576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f1f93-4b34-46dc-b26b-6c62ec1b0ba4 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:42.758617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f1f93-4b34-46dc-b26b-6c62ec1b0ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:42.759233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f1f93-4b34-46dc-b26b-6c62ec1b0ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:42.766671 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f3815b27-9ebb-480e-9d4f-d38f593db508 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:42.767889 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f3815b27-9ebb-480e-9d4f-d38f593db508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:42.776916 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 779/1541] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:24:42.778330 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c54f1f93-4b34-46dc-b26b-6c62ec1b0ba4 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:42.779568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c54f1f93-4b34-46dc-b26b-6c62ec1b0ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:42.785405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f127692-42c2-46b9-beb1-f6e99cabc6bb None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:42.785692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f127692-42c2-46b9-beb1-f6e99cabc6bb None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:42.785970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f127692-42c2-46b9-beb1-f6e99cabc6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:42.787881 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 763/1542] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:24:42.792394 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f1f93-4b34-46dc-b26b-6c62ec1b0ba4 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:42.801193 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f1f93-4b34-46dc-b26b-6c62ec1b0ba4 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:42.805877 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7c526-90f7-43af-a911-47ea96b2231c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:42.806496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7c526-90f7-43af-a911-47ea96b2231c admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:42.806774 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7c526-90f7-43af-a911-47ea96b2231c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:42.807043 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7c526-90f7-43af-a911-47ea96b2231c admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:42.807277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-1f127692-42c2-46b9-beb1-f6e99cabc6bb None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:42.807680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7c526-90f7-43af-a911-47ea96b2231c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:42.807980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7c526-90f7-43af-a911-47ea96b2231c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:42.808506 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-1f127692-42c2-46b9-beb1-f6e99cabc6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:42.809550 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7c526-90f7-43af-a911-47ea96b2231c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:42.816779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 780/1543] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:24:42.829308 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 764/1544] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 23 16:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:24:42.829510 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f127692-42c2-46b9-beb1-f6e99cabc6bb None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:42.830801 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7c526-90f7-43af-a911-47ea96b2231c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:42.831607 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f127692-42c2-46b9-beb1-f6e99cabc6bb None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:42.837288 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e1038-03c9-4534-be78-6bb8867512a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:42.838438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e1038-03c9-4534-be78-6bb8867512a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:42.838713 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e1038-03c9-4534-be78-6bb8867512a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:42.838977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e1038-03c9-4534-be78-6bb8867512a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:42.839625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e1038-03c9-4534-be78-6bb8867512a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81604) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 16:24:42.839940 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e1038-03c9-4534-be78-6bb8867512a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:42.840929 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: WARNING py.warnings [None req-d36e1038-03c9-4534-be78-6bb8867512a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:24:42.840929 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: warnings.warn(msg) Aug 23 16:24:42.840929 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: Aug 23 16:24:42.841331 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7c526-90f7-43af-a911-47ea96b2231c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:42.842041 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e1038-03c9-4534-be78-6bb8867512a7 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:42.846305 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be52d9-2df8-4a01-a9c9-81a706d4d6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:42.846906 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be52d9-2df8-4a01-a9c9-81a706d4d6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:42.847188 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be52d9-2df8-4a01-a9c9-81a706d4d6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:42.847489 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be52d9-2df8-4a01-a9c9-81a706d4d6d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:42.848140 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be52d9-2df8-4a01-a9c9-81a706d4d6d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:42.849160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: WARNING py.warnings [None req-b2be52d9-2df8-4a01-a9c9-81a706d4d6d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:24:42.849160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: warnings.warn(msg) Aug 23 16:24:42.849160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: Aug 23 16:24:42.850388 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be52d9-2df8-4a01-a9c9-81a706d4d6d9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:42.854649 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 781/1545] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 23 16:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 16:24:42.862431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e1038-03c9-4534-be78-6bb8867512a7 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:42.872632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e1038-03c9-4534-be78-6bb8867512a7 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:42.877338 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab746dc3-68d7-40c1-8031-c178cfb44dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:42.878014 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab746dc3-68d7-40c1-8031-c178cfb44dcd admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:42.878394 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab746dc3-68d7-40c1-8031-c178cfb44dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:42.878692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab746dc3-68d7-40c1-8031-c178cfb44dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:42.879304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab746dc3-68d7-40c1-8031-c178cfb44dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:42.881294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab746dc3-68d7-40c1-8031-c178cfb44dcd admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:42.891395 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 765/1546] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 23 16:24:42 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:24:42.895483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be52d9-2df8-4a01-a9c9-81a706d4d6d9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:42.913471 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 782/1547] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 23 16:24:42 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:24:42.915480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab746dc3-68d7-40c1-8031-c178cfb44dcd admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:42.960430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be52d9-2df8-4a01-a9c9-81a706d4d6d9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:42.975625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab746dc3-68d7-40c1-8031-c178cfb44dcd admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:42.982030 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4610175-6c37-4ac6-b29b-aa100f752f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:42.982693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4610175-6c37-4ac6-b29b-aa100f752f2c admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:42.982972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4610175-6c37-4ac6-b29b-aa100f752f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:42.983244 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4610175-6c37-4ac6-b29b-aa100f752f2c admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:42.983870 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4610175-6c37-4ac6-b29b-aa100f752f2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:42.984982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: WARNING py.warnings [None req-d4610175-6c37-4ac6-b29b-aa100f752f2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:24:42.984982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: warnings.warn(msg) Aug 23 16:24:42.984982 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: Aug 23 16:24:42.986095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4610175-6c37-4ac6-b29b-aa100f752f2c admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:43.007120 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 783/1548] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 16:24:42 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:24:43.011057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4610175-6c37-4ac6-b29b-aa100f752f2c admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:43.020282 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c580c-7d2c-4d1f-851a-6ef69dd579cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:43.020527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4610175-6c37-4ac6-b29b-aa100f752f2c admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:43.020929 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c580c-7d2c-4d1f-851a-6ef69dd579cd admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:43.021213 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c580c-7d2c-4d1f-851a-6ef69dd579cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:43.021496 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c580c-7d2c-4d1f-851a-6ef69dd579cd admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:43.022151 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c580c-7d2c-4d1f-851a-6ef69dd579cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:43.024566 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c580c-7d2c-4d1f-851a-6ef69dd579cd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:43.026402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43115b24-e859-459e-b0c9-daa7e78df59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:43.026993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43115b24-e859-459e-b0c9-daa7e78df59b admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:43.027277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43115b24-e859-459e-b0c9-daa7e78df59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:43.027550 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43115b24-e859-459e-b0c9-daa7e78df59b admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:43.028187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43115b24-e859-459e-b0c9-daa7e78df59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:43.029765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43115b24-e859-459e-b0c9-daa7e78df59b admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:43.041161 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 784/1549] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 23 16:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:24:43.045744 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43115b24-e859-459e-b0c9-daa7e78df59b admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:43.051054 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 766/1550] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 16:24:42 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 16:24:43.055343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c580c-7d2c-4d1f-851a-6ef69dd579cd admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:43.058209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43115b24-e859-459e-b0c9-daa7e78df59b admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:43.062831 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ad357-27c6-49d2-95dc-f3dc8a91e73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:43.063419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ad357-27c6-49d2-95dc-f3dc8a91e73d admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:43.063727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ad357-27c6-49d2-95dc-f3dc8a91e73d admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:43.063993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ad357-27c6-49d2-95dc-f3dc8a91e73d admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:43.064628 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ad357-27c6-49d2-95dc-f3dc8a91e73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:43.065143 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c580c-7d2c-4d1f-851a-6ef69dd579cd admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:43.066248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ad357-27c6-49d2-95dc-f3dc8a91e73d admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:43.069821 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affa456-5823-4368-b929-2facdfa44c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:43.071027 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affa456-5823-4368-b929-2facdfa44c40 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:43.071325 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affa456-5823-4368-b929-2facdfa44c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:43.071621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affa456-5823-4368-b929-2facdfa44c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:43.072238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affa456-5823-4368-b929-2facdfa44c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:43.073938 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affa456-5823-4368-b929-2facdfa44c40 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:43.077745 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 785/1551] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 23 16:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:24:43.081556 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ad357-27c6-49d2-95dc-f3dc8a91e73d admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:43.087654 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 767/1552] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 23 16:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:24:43.088676 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affa456-5823-4368-b929-2facdfa44c40 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:43.092251 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ad357-27c6-49d2-95dc-f3dc8a91e73d admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:43.097483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c80ba5-4a15-4dee-9823-dfc6ba22603b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:43.098166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c80ba5-4a15-4dee-9823-dfc6ba22603b admin admin] REQUEST_METHOD: `PUT` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:43.098318 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affa456-5823-4368-b929-2facdfa44c40 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:43.098446 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c80ba5-4a15-4dee-9823-dfc6ba22603b admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:43.098710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c80ba5-4a15-4dee-9823-dfc6ba22603b admin admin] PATH_INFO: `/v3/projects/477993ef6a5146c1af5ee9e32245fb77/users/a712cd7ef1e64b93bd2b2a764eb9e742/roles/8e4aa52bcd2a47389ee1c5de44fa28ca` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:43.103529 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c4962-2b9b-4b4a-b409-8e0643db9211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:43.104112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c4962-2b9b-4b4a-b409-8e0643db9211 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:43.104395 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c4962-2b9b-4b4a-b409-8e0643db9211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:43.104670 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c4962-2b9b-4b4a-b409-8e0643db9211 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:43.105306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c4962-2b9b-4b4a-b409-8e0643db9211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:43.107092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c4962-2b9b-4b4a-b409-8e0643db9211 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:43.113683 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c80ba5-4a15-4dee-9823-dfc6ba22603b admin admin] RBAC: Authorizing `identity:create_grant(project_id=477993ef6a5146c1af5ee9e32245fb77, user_id=a712cd7ef1e64b93bd2b2a764eb9e742, role_id=8e4aa52bcd2a47389ee1c5de44fa28ca)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:43.116343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c80ba5-4a15-4dee-9823-dfc6ba22603b admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:43.117866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 768/1553] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 23 16:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:24:43.122288 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c4962-2b9b-4b4a-b409-8e0643db9211 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:43.129287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 786/1554] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 23 16:24:43 2022] PUT /identity/v3/projects/477993ef6a5146c1af5ee9e32245fb77/users/a712cd7ef1e64b93bd2b2a764eb9e742/roles/8e4aa52bcd2a47389ee1c5de44fa28ca => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:24:43.132226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c4962-2b9b-4b4a-b409-8e0643db9211 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:43.134233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a574-93a7-4920-9426-0615f0462b96 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:43.134537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a574-93a7-4920-9426-0615f0462b96 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:43.134809 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093a574-93a7-4920-9426-0615f0462b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:43.145289 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:43.153687 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-6093a574-93a7-4920-9426-0615f0462b96 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:43.154929 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6093a574-93a7-4920-9426-0615f0462b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:43.195998 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfd2c0-479c-4c9f-8e64-ef21bd78de94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:43.196838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfd2c0-479c-4c9f-8e64-ef21bd78de94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:43.197153 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfd2c0-479c-4c9f-8e64-ef21bd78de94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:43.197432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfd2c0-479c-4c9f-8e64-ef21bd78de94 admin admin] PATH_INFO: `/v3/projects/290c50c2cf2743e686aed4516d21176f/users/9ac8d81f40714532a4b61e2d3bb0e729/roles/8e4aa52bcd2a47389ee1c5de44fa28ca` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:43.203182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:43.213050 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfd2c0-479c-4c9f-8e64-ef21bd78de94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=290c50c2cf2743e686aed4516d21176f, user_id=9ac8d81f40714532a4b61e2d3bb0e729, role_id=8e4aa52bcd2a47389ee1c5de44fa28ca)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:43.214108 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: WARNING py.warnings [None req-35dfd2c0-479c-4c9f-8e64-ef21bd78de94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:24:43.214108 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: warnings.warn(msg) Aug 23 16:24:43.214108 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: Aug 23 16:24:43.216095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfd2c0-479c-4c9f-8e64-ef21bd78de94 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:43.216258 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 787/1555] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:24:43.228194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093a574-93a7-4920-9426-0615f0462b96 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:43.229710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6093a574-93a7-4920-9426-0615f0462b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:43.230536 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 769/1556] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 23 16:24:43 2022] PUT /identity/v3/projects/290c50c2cf2743e686aed4516d21176f/users/9ac8d81f40714532a4b61e2d3bb0e729/roles/8e4aa52bcd2a47389ee1c5de44fa28ca => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:24:43.235590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c6345-14a6-4c4b-b1c3-56c0d0d33a41 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:43.235878 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c6345-14a6-4c4b-b1c3-56c0d0d33a41 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:43.236151 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c6345-14a6-4c4b-b1c3-56c0d0d33a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:43.255659 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f50c6345-14a6-4c4b-b1c3-56c0d0d33a41 None None] MFA Rules not processed for user `307f76b84605446ea643922d0a93ba9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:43.256862 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f50c6345-14a6-4c4b-b1c3-56c0d0d33a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:43.290547 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093a574-93a7-4920-9426-0615f0462b96 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:43.317402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 770/1557] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:24:43.327456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c6345-14a6-4c4b-b1c3-56c0d0d33a41 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:43.339206 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97367955-cc4c-4bb1-97c2-2e08cf741aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:43.339811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97367955-cc4c-4bb1-97c2-2e08cf741aae service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:43.340094 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97367955-cc4c-4bb1-97c2-2e08cf741aae service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:43.340400 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97367955-cc4c-4bb1-97c2-2e08cf741aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:43.349413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97367955-cc4c-4bb1-97c2-2e08cf741aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:43.350872 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97367955-cc4c-4bb1-97c2-2e08cf741aae service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:43.360594 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 788/1558] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:24:43.381700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c6345-14a6-4c4b-b1c3-56c0d0d33a41 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:43.386636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487776e0-e517-45ff-b7b2-dca185009e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:43.387377 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487776e0-e517-45ff-b7b2-dca185009e35 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:43.387662 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487776e0-e517-45ff-b7b2-dca185009e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:43.387936 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487776e0-e517-45ff-b7b2-dca185009e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:43.397703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487776e0-e517-45ff-b7b2-dca185009e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:43.399507 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487776e0-e517-45ff-b7b2-dca185009e35 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:43.409693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 771/1559] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:24:49.714752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535207a-2908-4d7a-924c-2ff19fd16f7d None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:49.715232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535207a-2908-4d7a-924c-2ff19fd16f7d None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:49.715314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535207a-2908-4d7a-924c-2ff19fd16f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:49.749581 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-3535207a-2908-4d7a-924c-2ff19fd16f7d None None] MFA Rules not processed for user `a712cd7ef1e64b93bd2b2a764eb9e742`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:49.752122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-3535207a-2908-4d7a-924c-2ff19fd16f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:49.849307 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 789/1560] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:24:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:24:49.855145 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487776e0-e517-45ff-b7b2-dca185009e35 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:49.866368 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487776e0-e517-45ff-b7b2-dca185009e35 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:49.871778 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd32fb-db01-4529-b03c-f0c203086842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:49.872408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd32fb-db01-4529-b03c-f0c203086842 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:49.872691 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd32fb-db01-4529-b03c-f0c203086842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:49.872970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd32fb-db01-4529-b03c-f0c203086842 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:49.873615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd32fb-db01-4529-b03c-f0c203086842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:49.875774 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd32fb-db01-4529-b03c-f0c203086842 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:49.953806 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 772/1561] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 23 16:24:49 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:24:49.957734 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535207a-2908-4d7a-924c-2ff19fd16f7d None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:49.971873 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535207a-2908-4d7a-924c-2ff19fd16f7d None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:50.039656 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:50.072391 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29daeb8-48fa-47a4-9cc2-8f064f22df58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:50.074411 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29daeb8-48fa-47a4-9cc2-8f064f22df58 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:50.074806 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29daeb8-48fa-47a4-9cc2-8f064f22df58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:50.075185 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29daeb8-48fa-47a4-9cc2-8f064f22df58 admin admin] PATH_INFO: `/v3/users` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:50.076358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29daeb8-48fa-47a4-9cc2-8f064f22df58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:50.078503 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29daeb8-48fa-47a4-9cc2-8f064f22df58 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:50.131878 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 790/1562] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 16:24:49 2022] POST /identity/v3/users => generated 296 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:24:50.139626 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd32fb-db01-4529-b03c-f0c203086842 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:50.165610 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd32fb-db01-4529-b03c-f0c203086842 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:50.167480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144429de-dc7d-4f11-b102-5e6585be42b1 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:50.167733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144429de-dc7d-4f11-b102-5e6585be42b1 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:50.168021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144429de-dc7d-4f11-b102-5e6585be42b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:50.170161 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f1785-ff0a-40fe-9c92-479b17577b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:50.170979 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f1785-ff0a-40fe-9c92-479b17577b2b admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:50.171271 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f1785-ff0a-40fe-9c92-479b17577b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:50.171545 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f1785-ff0a-40fe-9c92-479b17577b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:50.172230 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f1785-ff0a-40fe-9c92-479b17577b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:50.181390 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f1785-ff0a-40fe-9c92-479b17577b2b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:50.193641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 773/1563] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 23 16:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:24:50.198144 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f1785-ff0a-40fe-9c92-479b17577b2b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:50.204990 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-144429de-dc7d-4f11-b102-5e6585be42b1 None None] MFA Rules not processed for user `9ac8d81f40714532a4b61e2d3bb0e729`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:50.206261 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-144429de-dc7d-4f11-b102-5e6585be42b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:50.210410 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f1785-ff0a-40fe-9c92-479b17577b2b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:50.217120 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d78140-079b-4b4b-bfe8-5860b82a4d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:50.218408 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d78140-079b-4b4b-bfe8-5860b82a4d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:50.218914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d78140-079b-4b4b-bfe8-5860b82a4d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:50.219539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d78140-079b-4b4b-bfe8-5860b82a4d9b admin admin] PATH_INFO: `/v3/projects/0f22089821c642a68e725df2128ad7e5/users/1632563db2f64674a9e483fcbddd7870/roles/8de0c87242d7426ea25a510b578c02aa` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:50.230468 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:50.245558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d78140-079b-4b4b-bfe8-5860b82a4d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f22089821c642a68e725df2128ad7e5, user_id=1632563db2f64674a9e483fcbddd7870, role_id=8de0c87242d7426ea25a510b578c02aa)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:50.249192 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d78140-079b-4b4b-bfe8-5860b82a4d9b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:50.268623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 774/1564] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 23 16:24:50 2022] PUT /identity/v3/projects/0f22089821c642a68e725df2128ad7e5/users/1632563db2f64674a9e483fcbddd7870/roles/8de0c87242d7426ea25a510b578c02aa => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:24:50.273332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d78140-079b-4b4b-bfe8-5860b82a4d9b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:50.327365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 791/1565] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:24:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:24:50.328793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144429de-dc7d-4f11-b102-5e6585be42b1 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:50.341080 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144429de-dc7d-4f11-b102-5e6585be42b1 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:50.363054 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d78140-079b-4b4b-bfe8-5860b82a4d9b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:50.368111 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e07e7-97d8-46a9-b9f0-0c7af4786a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:50.368865 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e07e7-97d8-46a9-b9f0-0c7af4786a0b admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:50.369288 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e07e7-97d8-46a9-b9f0-0c7af4786a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:50.369663 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e07e7-97d8-46a9-b9f0-0c7af4786a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:50.370470 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e07e7-97d8-46a9-b9f0-0c7af4786a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:50.372252 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e07e7-97d8-46a9-b9f0-0c7af4786a0b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:50.387668 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 775/1566] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 23 16:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 16:24:50.391835 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e07e7-97d8-46a9-b9f0-0c7af4786a0b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:50.403972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e07e7-97d8-46a9-b9f0-0c7af4786a0b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:50.406563 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a75ce-d995-481d-8e52-82b2fcbb8704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:50.407249 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a75ce-d995-481d-8e52-82b2fcbb8704 admin admin] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:50.407461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a75ce-d995-481d-8e52-82b2fcbb8704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:50.407740 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a75ce-d995-481d-8e52-82b2fcbb8704 admin admin] PATH_INFO: `/v3/projects` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:50.408445 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a75ce-d995-481d-8e52-82b2fcbb8704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:50.409472 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1b70b-e57a-4b95-99a6-f979ce0257c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:50.410247 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1b70b-e57a-4b95-99a6-f979ce0257c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:50.410396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a75ce-d995-481d-8e52-82b2fcbb8704 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:50.410691 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1b70b-e57a-4b95-99a6-f979ce0257c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:50.411026 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1b70b-e57a-4b95-99a6-f979ce0257c2 admin admin] PATH_INFO: `/v3/projects/0f22089821c642a68e725df2128ad7e5/users/1632563db2f64674a9e483fcbddd7870/roles/8de0c87242d7426ea25a510b578c02aa` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:50.413124 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1b70b-e57a-4b95-99a6-f979ce0257c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f22089821c642a68e725df2128ad7e5, user_id=1632563db2f64674a9e483fcbddd7870, role_id=8de0c87242d7426ea25a510b578c02aa)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:50.416661 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1b70b-e57a-4b95-99a6-f979ce0257c2 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:50.428897 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 776/1567] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 23 16:24:50 2022] PUT /identity/v3/projects/0f22089821c642a68e725df2128ad7e5/users/1632563db2f64674a9e483fcbddd7870/roles/8de0c87242d7426ea25a510b578c02aa => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:24:50.483715 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 792/1568] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 23 16:24:50 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:24:50.485548 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1b70b-e57a-4b95-99a6-f979ce0257c2 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:50.574098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1b70b-e57a-4b95-99a6-f979ce0257c2 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:50.659547 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766461b-c4c2-4c71-b850-ef5a846ce56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:50.660333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766461b-c4c2-4c71-b850-ef5a846ce56e admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:50.660714 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766461b-c4c2-4c71-b850-ef5a846ce56e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:50.661084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766461b-c4c2-4c71-b850-ef5a846ce56e admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:50.661817 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766461b-c4c2-4c71-b850-ef5a846ce56e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:50.664080 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3766461b-c4c2-4c71-b850-ef5a846ce56e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:50.690405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 777/1569] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 16:24:50 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 16:24:50.694045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a75ce-d995-481d-8e52-82b2fcbb8704 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:50.710494 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a75ce-d995-481d-8e52-82b2fcbb8704 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:50.717340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3449ed8-1192-4945-87b4-4244081880c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:50.718222 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3449ed8-1192-4945-87b4-4244081880c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:50.718577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3449ed8-1192-4945-87b4-4244081880c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:50.718857 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3449ed8-1192-4945-87b4-4244081880c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:50.719523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3449ed8-1192-4945-87b4-4244081880c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:50.721364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3449ed8-1192-4945-87b4-4244081880c0 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:50.741900 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 793/1570] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 23 16:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:24:50.747454 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766461b-c4c2-4c71-b850-ef5a846ce56e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:50.770182 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3766461b-c4c2-4c71-b850-ef5a846ce56e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:50.778866 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1fd41-77da-4dbc-bae8-d5be9a337958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:50.779999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1fd41-77da-4dbc-bae8-d5be9a337958 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:50.780584 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1fd41-77da-4dbc-bae8-d5be9a337958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:50.781040 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1fd41-77da-4dbc-bae8-d5be9a337958 admin admin] PATH_INFO: `/v3/projects/ee8ab034c6174ac8bddcb700b2020f17/users/f47cea9ac35c49a4b2bb4a2037256c53/roles/8de0c87242d7426ea25a510b578c02aa` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:50.784014 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:50.818628 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1fd41-77da-4dbc-bae8-d5be9a337958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8ab034c6174ac8bddcb700b2020f17, user_id=f47cea9ac35c49a4b2bb4a2037256c53, role_id=8de0c87242d7426ea25a510b578c02aa)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:50.825432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1fd41-77da-4dbc-bae8-d5be9a337958 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:50.845520 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 778/1571] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 23 16:24:50 2022] PUT /identity/v3/projects/ee8ab034c6174ac8bddcb700b2020f17/users/f47cea9ac35c49a4b2bb4a2037256c53/roles/8de0c87242d7426ea25a510b578c02aa => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:24:50.846782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3449ed8-1192-4945-87b4-4244081880c0 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:50.859803 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3449ed8-1192-4945-87b4-4244081880c0 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:50.942766 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:50.977028 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04e3c4-7d63-4fa6-bf36-8b6c2955a235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:50.978001 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04e3c4-7d63-4fa6-bf36-8b6c2955a235 admin admin] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:50.979239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04e3c4-7d63-4fa6-bf36-8b6c2955a235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:50.979239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04e3c4-7d63-4fa6-bf36-8b6c2955a235 admin admin] PATH_INFO: `/v3/roles` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:50.979568 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04e3c4-7d63-4fa6-bf36-8b6c2955a235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:50.981298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04e3c4-7d63-4fa6-bf36-8b6c2955a235 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:50.994546 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 794/1572] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 23 16:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 16:24:50.998885 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1fd41-77da-4dbc-bae8-d5be9a337958 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:51.011784 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1fd41-77da-4dbc-bae8-d5be9a337958 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:51.017844 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf5aa8-be43-414d-9683-d884f82dee0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:51.018539 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf5aa8-be43-414d-9683-d884f82dee0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:51.018819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf5aa8-be43-414d-9683-d884f82dee0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:51.019084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf5aa8-be43-414d-9683-d884f82dee0a admin admin] PATH_INFO: `/v3/projects/ee8ab034c6174ac8bddcb700b2020f17/users/f47cea9ac35c49a4b2bb4a2037256c53/roles/8de0c87242d7426ea25a510b578c02aa` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:51.020989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf5aa8-be43-414d-9683-d884f82dee0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8ab034c6174ac8bddcb700b2020f17, user_id=f47cea9ac35c49a4b2bb4a2037256c53, role_id=8de0c87242d7426ea25a510b578c02aa)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:51.025064 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf5aa8-be43-414d-9683-d884f82dee0a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:51.040710 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 779/1573] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 23 16:24:50 2022] PUT /identity/v3/projects/ee8ab034c6174ac8bddcb700b2020f17/users/f47cea9ac35c49a4b2bb4a2037256c53/roles/8de0c87242d7426ea25a510b578c02aa => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:24:56.013162 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2e2dd-ad44-48c5-970d-e3bd642531b3 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:56.013656 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2e2dd-ad44-48c5-970d-e3bd642531b3 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:56.013733 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2e2dd-ad44-48c5-970d-e3bd642531b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:56.048918 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-0fd2e2dd-ad44-48c5-970d-e3bd642531b3 None None] MFA Rules not processed for user `1632563db2f64674a9e483fcbddd7870`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:56.051010 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-0fd2e2dd-ad44-48c5-970d-e3bd642531b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:56.170213 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 795/1574] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:24:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:24:56.179812 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf5aa8-be43-414d-9683-d884f82dee0a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:56.182316 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-85cf5aa8-be43-414d-9683-d884f82dee0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:56.307712 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf5aa8-be43-414d-9683-d884f82dee0a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:56.314046 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea50685-15bf-4c9a-88d6-b64498388aa1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3ddab91bbb24d119dd302024f458d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:56.314718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea50685-15bf-4c9a-88d6-b64498388aa1 service glance] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:56.315003 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea50685-15bf-4c9a-88d6-b64498388aa1 service glance] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:56.315541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea50685-15bf-4c9a-88d6-b64498388aa1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:56.406595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea50685-15bf-4c9a-88d6-b64498388aa1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:56.408266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea50685-15bf-4c9a-88d6-b64498388aa1 service glance] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:56.426929 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 780/1575] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:24:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:24:56.775864 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328ca1b-f410-420f-aa91-96963f248ecd None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:56.776159 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328ca1b-f410-420f-aa91-96963f248ecd None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:56.776434 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328ca1b-f410-420f-aa91-96963f248ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:56.840217 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-6328ca1b-f410-420f-aa91-96963f248ecd None None] MFA Rules not processed for user `f47cea9ac35c49a4b2bb4a2037256c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:56.841455 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-6328ca1b-f410-420f-aa91-96963f248ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:57.047404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 796/1576] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:24:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:24:57.061970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea50685-15bf-4c9a-88d6-b64498388aa1 service glance] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:57.084515 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea50685-15bf-4c9a-88d6-b64498388aa1 service glance] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:57.090095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6390e-feed-43ff-acc1-333767d495ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3ddab91bbb24d119dd302024f458d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:57.090681 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6390e-feed-43ff-acc1-333767d495ad service glance] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:57.091024 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6390e-feed-43ff-acc1-333767d495ad service glance] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:57.093703 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6390e-feed-43ff-acc1-333767d495ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:57.239349 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6390e-feed-43ff-acc1-333767d495ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:57.247170 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6390e-feed-43ff-acc1-333767d495ad service glance] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:57.287361 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 781/1577] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:24:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:24:57.712991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efae8e-93f1-40cb-bb47-9b87173211df None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:57.713534 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efae8e-93f1-40cb-bb47-9b87173211df None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:57.713995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efae8e-93f1-40cb-bb47-9b87173211df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:57.868312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-21efae8e-93f1-40cb-bb47-9b87173211df None None] MFA Rules not processed for user `5fe3a02c2bc247efa354ca5bac39ec4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:57.878108 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-21efae8e-93f1-40cb-bb47-9b87173211df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:57.899702 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=100 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:57.997051 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 797/1578] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 23 16:24:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:24:58.162470 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6390e-feed-43ff-acc1-333767d495ad service glance] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:58.165254 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9cb6390e-feed-43ff-acc1-333767d495ad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:58.170740 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:24:58.328541 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6390e-feed-43ff-acc1-333767d495ad service glance] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:58.337505 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe010f6f-010b-478f-a8c5-e7ee60d9af04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fb290911bc4de887d04b71731f76b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:58.338491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe010f6f-010b-478f-a8c5-e7ee60d9af04 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:58.338993 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe010f6f-010b-478f-a8c5-e7ee60d9af04 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:58.339449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe010f6f-010b-478f-a8c5-e7ee60d9af04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:58.350095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe010f6f-010b-478f-a8c5-e7ee60d9af04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:58.352904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe010f6f-010b-478f-a8c5-e7ee60d9af04 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:58.365016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 782/1579] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 23 16:24:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 16:24:58.728219 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb0307-c560-44df-af8e-d74c9b660b7b None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:58.729133 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb0307-c560-44df-af8e-d74c9b660b7b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:58.729624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb0307-c560-44df-af8e-d74c9b660b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:58.756354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-4eeb0307-c560-44df-af8e-d74c9b660b7b None None] MFA Rules not processed for user `5fe3a02c2bc247efa354ca5bac39ec4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:24:58.758532 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4eeb0307-c560-44df-af8e-d74c9b660b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:24:58.774097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 798/1580] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 23 16:24:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:24:58.781677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe010f6f-010b-478f-a8c5-e7ee60d9af04 service swift] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:24:58.793265 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe010f6f-010b-478f-a8c5-e7ee60d9af04 service swift] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:24:58.810955 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d814435-87c4-4933-bd65-30f6807174bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fb290911bc4de887d04b71731f76b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:24:58.811813 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d814435-87c4-4933-bd65-30f6807174bb service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:24:58.811888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d814435-87c4-4933-bd65-30f6807174bb service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:24:58.812141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d814435-87c4-4933-bd65-30f6807174bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:24:58.826802 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d814435-87c4-4933-bd65-30f6807174bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:24:58.828430 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d814435-87c4-4933-bd65-30f6807174bb service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:24:58.840467 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 783/1581] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 23 16:24:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:25:08.155836 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ed7ae-0aec-4d70-8711-1d295d2c0992 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:08.156356 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ed7ae-0aec-4d70-8711-1d295d2c0992 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:08.156458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ed7ae-0aec-4d70-8711-1d295d2c0992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:08.175720 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-a24ed7ae-0aec-4d70-8711-1d295d2c0992 None None] MFA Rules not processed for user `9ac8d81f40714532a4b61e2d3bb0e729`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:08.176908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a24ed7ae-0aec-4d70-8711-1d295d2c0992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:08.184914 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 799/1582] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:25:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:25:08.497094 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b6e27-b16e-4dbb-9b26-254e59248ef2 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:08.497589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b6e27-b16e-4dbb-9b26-254e59248ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:08.497740 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b6e27-b16e-4dbb-9b26-254e59248ef2 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:08.499122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 784/1583] 10.222.0.16 () {54 vars in 962 bytes} [Tue Aug 23 16:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:08.504196 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7dfd3-9894-4898-8b56-9d0290341784 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:08.504481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7dfd3-9894-4898-8b56-9d0290341784 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:08.504756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7dfd3-9894-4898-8b56-9d0290341784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:08.542203 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-9af7dfd3-9894-4898-8b56-9d0290341784 None None] MFA Rules not processed for user `767ca33ca8e244f8a0cc773e3b6abefb`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:08.543410 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9af7dfd3-9894-4898-8b56-9d0290341784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:08.611831 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 800/1584] 10.222.0.16 () {58 vars in 1059 bytes} [Tue Aug 23 16:25:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:25:08.617438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71413896-ce93-4807-bf5c-b1e5c8c725c4 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:08.617720 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71413896-ce93-4807-bf5c-b1e5c8c725c4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:08.617995 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71413896-ce93-4807-bf5c-b1e5c8c725c4 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:08.619367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 785/1585] 10.222.0.16 () {54 vars in 912 bytes} [Tue Aug 23 16:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:08.624147 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b2b8b-d523-49e4-9fbb-8dac95c3e90c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:08.624432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b2b8b-d523-49e4-9fbb-8dac95c3e90c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:08.624707 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b2b8b-d523-49e4-9fbb-8dac95c3e90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:08.644822 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-231b2b8b-d523-49e4-9fbb-8dac95c3e90c None None] MFA Rules not processed for user `767ca33ca8e244f8a0cc773e3b6abefb`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:08.645947 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-231b2b8b-d523-49e4-9fbb-8dac95c3e90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:08.655831 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 801/1586] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 23 16:25:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:25:08.668431 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71413896-ce93-4807-bf5c-b1e5c8c725c4 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:08.670170 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-71413896-ce93-4807-bf5c-b1e5c8c725c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:08.683752 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71413896-ce93-4807-bf5c-b1e5c8c725c4 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:08.687424 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12308b50-013d-4a10-9e9f-0117a64787ec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3ddab91bbb24d119dd302024f458d35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:08.688371 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12308b50-013d-4a10-9e9f-0117a64787ec service glance] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:08.688585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12308b50-013d-4a10-9e9f-0117a64787ec service glance] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:08.688867 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12308b50-013d-4a10-9e9f-0117a64787ec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:08.699589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12308b50-013d-4a10-9e9f-0117a64787ec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:08.701002 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12308b50-013d-4a10-9e9f-0117a64787ec service glance] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:08.716508 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 786/1587] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:25:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:25:09.189419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729415b-9a67-4b2a-8386-379147b19c2b None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:09.190050 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729415b-9a67-4b2a-8386-379147b19c2b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:09.190050 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729415b-9a67-4b2a-8386-379147b19c2b None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:09.191601 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 802/1588] 10.222.0.16 () {54 vars in 912 bytes} [Tue Aug 23 16:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:09.198269 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae0c71-38de-421b-b01b-71041c653dc8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:09.198654 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae0c71-38de-421b-b01b-71041c653dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:09.199004 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae0c71-38de-421b-b01b-71041c653dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:09.242246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-05ae0c71-38de-421b-b01b-71041c653dc8 None None] MFA Rules not processed for user `9eae00506f75402fbf972a8991ad0a68`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:09.243674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-05ae0c71-38de-421b-b01b-71041c653dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:09.298358 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 787/1589] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 23 16:25:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:25:09.310402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729415b-9a67-4b2a-8386-379147b19c2b None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:09.326251 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3729415b-9a67-4b2a-8386-379147b19c2b None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:09.329828 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb68c4-5753-495e-9ef1-a36daf43f89d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:09.330449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb68c4-5753-495e-9ef1-a36daf43f89d service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:09.330729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb68c4-5753-495e-9ef1-a36daf43f89d service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:09.330998 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb68c4-5753-495e-9ef1-a36daf43f89d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:09.338426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb68c4-5753-495e-9ef1-a36daf43f89d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:09.339849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb68c4-5753-495e-9ef1-a36daf43f89d service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:09.347555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 803/1590] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:25:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:25:09.736482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efb26b-2cc2-4c56-ac71-4c7962e27091 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:09.737025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efb26b-2cc2-4c56-ac71-4c7962e27091 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:09.737120 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efb26b-2cc2-4c56-ac71-4c7962e27091 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:09.738845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 788/1591] 10.222.0.16 () {54 vars in 962 bytes} [Tue Aug 23 16:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:09.752450 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0e2c-4f45-4ea9-ba01-944f5de21145 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:09.752701 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0e2c-4f45-4ea9-ba01-944f5de21145 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:09.752975 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0e2c-4f45-4ea9-ba01-944f5de21145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:09.771126 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0dcd3-611f-4e45-a28d-249f0a1eaf7b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:09.771461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0dcd3-611f-4e45-a28d-249f0a1eaf7b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:09.771740 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0dcd3-611f-4e45-a28d-249f0a1eaf7b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:09.773939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 789/1592] 10.222.0.16 () {54 vars in 961 bytes} [Tue Aug 23 16:25:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:25:09.779909 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3843b-abd6-4b2c-b8cd-80f6eab01b77 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:09.779909 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3843b-abd6-4b2c-b8cd-80f6eab01b77 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:09.780478 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3843b-abd6-4b2c-b8cd-80f6eab01b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:09.808953 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-4eac0e2c-4f45-4ea9-ba01-944f5de21145 None None] MFA Rules not processed for user `767ca33ca8e244f8a0cc773e3b6abefb`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:09.810306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4eac0e2c-4f45-4ea9-ba01-944f5de21145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:09.810624 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e2d3843b-abd6-4b2c-b8cd-80f6eab01b77 None None] MFA Rules not processed for user `9cd1309c315e49eea6af4691d14c3e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:09.811811 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e2d3843b-abd6-4b2c-b8cd-80f6eab01b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:09.821287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 804/1593] 10.222.0.16 () {58 vars in 1059 bytes} [Tue Aug 23 16:25:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:25:09.832179 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6b5f6-3843-49de-a61f-c8edec9bba97 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:09.832916 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6b5f6-3843-49de-a61f-c8edec9bba97 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:09.833485 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6b5f6-3843-49de-a61f-c8edec9bba97 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:09.837119 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 805/1594] 10.222.0.16 () {54 vars in 912 bytes} [Tue Aug 23 16:25:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:25:09.845231 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee655c7-f9b4-4146-a339-9ad4c2b03733 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:09.846443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee655c7-f9b4-4146-a339-9ad4c2b03733 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:09.846958 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee655c7-f9b4-4146-a339-9ad4c2b03733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:09.867941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:09.880722 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-dee655c7-f9b4-4146-a339-9ad4c2b03733 None None] MFA Rules not processed for user `767ca33ca8e244f8a0cc773e3b6abefb`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:09.882736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-dee655c7-f9b4-4146-a339-9ad4c2b03733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:09.893786 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 806/1595] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 23 16:25:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:25:09.899915 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 790/1596] 10.222.0.16 () {58 vars in 1058 bytes} [Tue Aug 23 16:25:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:25:09.906249 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee655c7-f9b4-4146-a339-9ad4c2b03733 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:09.907712 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3843b-abd6-4b2c-b8cd-80f6eab01b77 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:09.916396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee655c7-f9b4-4146-a339-9ad4c2b03733 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:09.917873 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3843b-abd6-4b2c-b8cd-80f6eab01b77 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:09.920176 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0da7bc-5857-4026-94f9-81b849484b1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:09.920776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0da7bc-5857-4026-94f9-81b849484b1d service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:09.921051 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0da7bc-5857-4026-94f9-81b849484b1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:09.921320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0da7bc-5857-4026-94f9-81b849484b1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:09.922981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fe48f-b448-4adc-9dcd-28b2e1e4061e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd1309c315e49eea6af4691d14c3e90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:09.923578 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fe48f-b448-4adc-9dcd-28b2e1e4061e service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:09.923857 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fe48f-b448-4adc-9dcd-28b2e1e4061e service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:09.924133 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fe48f-b448-4adc-9dcd-28b2e1e4061e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:09.925904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f92fe48f-b448-4adc-9dcd-28b2e1e4061e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:09.932354 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0da7bc-5857-4026-94f9-81b849484b1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:09.933795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0da7bc-5857-4026-94f9-81b849484b1d service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:09.945783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92fe48f-b448-4adc-9dcd-28b2e1e4061e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:09.948141 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92fe48f-b448-4adc-9dcd-28b2e1e4061e service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:09.955352 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 807/1597] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:25:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:25:09.961781 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 791/1598] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:25:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 16:25:11.759117 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062b71a-406e-42a5-b67e-c8b0f8ee1c7f None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:11.759942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062b71a-406e-42a5-b67e-c8b0f8ee1c7f None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:11.760228 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062b71a-406e-42a5-b67e-c8b0f8ee1c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:11.780690 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-4062b71a-406e-42a5-b67e-c8b0f8ee1c7f None None] MFA Rules not processed for user `5fe3a02c2bc247efa354ca5bac39ec4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:11.782189 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4062b71a-406e-42a5-b67e-c8b0f8ee1c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:11.789731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 808/1599] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 23 16:25:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:25:11.805410 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fe48f-b448-4adc-9dcd-28b2e1e4061e service placement] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:11.818935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fe48f-b448-4adc-9dcd-28b2e1e4061e service placement] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:11.830091 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b1a46-fafb-4464-be39-d20714c35d8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fb290911bc4de887d04b71731f76b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:11.830740 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b1a46-fafb-4464-be39-d20714c35d8d service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:11.831018 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b1a46-fafb-4464-be39-d20714c35d8d service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:11.831288 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b1a46-fafb-4464-be39-d20714c35d8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:11.846800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b1a46-fafb-4464-be39-d20714c35d8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:11.848416 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b1a46-fafb-4464-be39-d20714c35d8d service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:11.861892 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 792/1600] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 23 16:25:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:25:12.699951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93ab1a-c3ef-4c1a-80a8-c392d9fc7e2a None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:12.700579 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93ab1a-c3ef-4c1a-80a8-c392d9fc7e2a None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:12.700966 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93ab1a-c3ef-4c1a-80a8-c392d9fc7e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:12.756398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-2d93ab1a-c3ef-4c1a-80a8-c392d9fc7e2a None None] MFA Rules not processed for user `9eae00506f75402fbf972a8991ad0a68`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:12.767068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-2d93ab1a-c3ef-4c1a-80a8-c392d9fc7e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:12.784575 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 809/1601] 10.222.0.60 () {58 vars in 1015 bytes} [Tue Aug 23 16:25:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:25:19.759542 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b1a46-fafb-4464-be39-d20714c35d8d service swift] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:19.768832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b1a46-fafb-4464-be39-d20714c35d8d service swift] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:19.772443 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880f839-2b63-4eb8-820d-d353c23bf79e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:19.773036 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880f839-2b63-4eb8-820d-d353c23bf79e service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:19.773314 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880f839-2b63-4eb8-820d-d353c23bf79e service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:19.773586 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880f839-2b63-4eb8-820d-d353c23bf79e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:19.780667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880f839-2b63-4eb8-820d-d353c23bf79e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:19.782092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880f839-2b63-4eb8-820d-d353c23bf79e service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:19.789700 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 793/1602] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:25:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:25:20.590500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09b0fe-8506-45d6-974b-52bbc79e908e None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:20.591075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09b0fe-8506-45d6-974b-52bbc79e908e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:20.591075 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09b0fe-8506-45d6-974b-52bbc79e908e None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:20.592367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 810/1603] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 23 16:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 16:25:20.618021 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538619d-1c3c-4d1d-a911-efe9d9410068 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:20.618420 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538619d-1c3c-4d1d-a911-efe9d9410068 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:20.618769 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538619d-1c3c-4d1d-a911-efe9d9410068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:20.641298 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7538619d-1c3c-4d1d-a911-efe9d9410068 None None] MFA Rules not processed for user `767ca33ca8e244f8a0cc773e3b6abefb`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:20.642462 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7538619d-1c3c-4d1d-a911-efe9d9410068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:20.652464 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 794/1604] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 23 16:25:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:25:20.681957 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09b0fe-8506-45d6-974b-52bbc79e908e None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:20.696821 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09b0fe-8506-45d6-974b-52bbc79e908e None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:20.702488 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c133a89-ccc0-4b07-b940-7082dfe1fc64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:20.703091 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c133a89-ccc0-4b07-b940-7082dfe1fc64 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:20.703367 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c133a89-ccc0-4b07-b940-7082dfe1fc64 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:20.703635 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c133a89-ccc0-4b07-b940-7082dfe1fc64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:20.715423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c133a89-ccc0-4b07-b940-7082dfe1fc64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:20.717041 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c133a89-ccc0-4b07-b940-7082dfe1fc64 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:20.728323 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 811/1605] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:25:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:25:26.032823 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385dad5-aa73-45e1-9121-fe69a4d44879 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:26.033405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385dad5-aa73-45e1-9121-fe69a4d44879 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:26.033485 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385dad5-aa73-45e1-9121-fe69a4d44879 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:26.034831 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 795/1606] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 23 16:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:25:26.044154 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9fc8a-47d0-4512-9b48-27cf4c349903 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:26.044944 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9fc8a-47d0-4512-9b48-27cf4c349903 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:26.045161 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9fc8a-47d0-4512-9b48-27cf4c349903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:26.067398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-4ce9fc8a-47d0-4512-9b48-27cf4c349903 None None] MFA Rules not processed for user `767ca33ca8e244f8a0cc773e3b6abefb`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:26.068661 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-4ce9fc8a-47d0-4512-9b48-27cf4c349903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:26.081198 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 812/1607] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 23 16:25:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:25:26.097682 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385dad5-aa73-45e1-9121-fe69a4d44879 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:26.113131 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385dad5-aa73-45e1-9121-fe69a4d44879 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:26.119490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3de4ad-4ecc-4110-855a-2227c8decf12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:26.120087 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3de4ad-4ecc-4110-855a-2227c8decf12 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:26.120364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3de4ad-4ecc-4110-855a-2227c8decf12 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:26.120634 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3de4ad-4ecc-4110-855a-2227c8decf12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:26.129937 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3de4ad-4ecc-4110-855a-2227c8decf12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:26.132073 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3de4ad-4ecc-4110-855a-2227c8decf12 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:26.143552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 796/1608] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:25:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:25:36.064825 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=99 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:36.139094 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=37 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:25:45.569123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9fc8a-47d0-4512-9b48-27cf4c349903 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:45.579818 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9fc8a-47d0-4512-9b48-27cf4c349903 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:45.583602 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed96a0-2e5b-4ed4-9816-d25b03995515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:45.584639 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed96a0-2e5b-4ed4-9816-d25b03995515 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:45.584924 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed96a0-2e5b-4ed4-9816-d25b03995515 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:45.585194 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed96a0-2e5b-4ed4-9816-d25b03995515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:45.596232 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed96a0-2e5b-4ed4-9816-d25b03995515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:45.597858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed96a0-2e5b-4ed4-9816-d25b03995515 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:45.607598 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 813/1609] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:25:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:25:53.463236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef1c2c-27fb-4445-b9ee-15785ba11fe0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:53.463795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef1c2c-27fb-4445-b9ee-15785ba11fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:53.463795 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef1c2c-27fb-4445-b9ee-15785ba11fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:53.482320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-80ef1c2c-27fb-4445-b9ee-15785ba11fe0 None None] MFA Rules not processed for user `a712cd7ef1e64b93bd2b2a764eb9e742`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:53.483531 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-80ef1c2c-27fb-4445-b9ee-15785ba11fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:53.490365 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 797/1610] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:25:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:25:53.968656 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9069b8b-d370-4150-b549-a10ad4418f8b None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:53.969142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9069b8b-d370-4150-b549-a10ad4418f8b None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:53.969142 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9069b8b-d370-4150-b549-a10ad4418f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:53.988295 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-e9069b8b-d370-4150-b549-a10ad4418f8b None None] MFA Rules not processed for user `9eae00506f75402fbf972a8991ad0a68`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:25:53.989477 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e9069b8b-d370-4150-b549-a10ad4418f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:25:53.996736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 814/1611] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 23 16:25:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:25:54.008423 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef1c2c-27fb-4445-b9ee-15785ba11fe0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:25:54.017592 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef1c2c-27fb-4445-b9ee-15785ba11fe0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:25:54.021035 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6ce86-65bb-4ba2-83a6-8934cfa757e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:25:54.021623 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6ce86-65bb-4ba2-83a6-8934cfa757e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:25:54.021898 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6ce86-65bb-4ba2-83a6-8934cfa757e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:25:54.022202 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6ce86-65bb-4ba2-83a6-8934cfa757e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:25:54.028952 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6ce86-65bb-4ba2-83a6-8934cfa757e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:25:54.030659 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6ce86-65bb-4ba2-83a6-8934cfa757e7 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:25:54.038190 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 798/1612] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:25:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:26:03.983644 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=9 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:04.034911 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=9 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:35.926697 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eec40-2590-4c75-ae9d-8e9294821098 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:35.927253 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eec40-2590-4c75-ae9d-8e9294821098 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:35.927253 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eec40-2590-4c75-ae9d-8e9294821098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:35.945615 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-f66eec40-2590-4c75-ae9d-8e9294821098 None None] MFA Rules not processed for user `a712cd7ef1e64b93bd2b2a764eb9e742`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:35.947123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-f66eec40-2590-4c75-ae9d-8e9294821098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:35.953742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 815/1613] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:26:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:45.940608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:26:53.889942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e7355-d7de-417b-8484-8eb5e79028ae None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:53.890527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e7355-d7de-417b-8484-8eb5e79028ae None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:53.890527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e7355-d7de-417b-8484-8eb5e79028ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:53.910849 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1b7e7355-d7de-417b-8484-8eb5e79028ae None None] MFA Rules not processed for user `5fe3a02c2bc247efa354ca5bac39ec4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:53.912034 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1b7e7355-d7de-417b-8484-8eb5e79028ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:53.920067 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 799/1614] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 23 16:26:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:26:53.961608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eec40-2590-4c75-ae9d-8e9294821098 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:26:53.973494 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eec40-2590-4c75-ae9d-8e9294821098 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:26:53.979291 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179401d-5d64-44e8-800b-1be7f95d360c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fb290911bc4de887d04b71731f76b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:26:53.979877 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179401d-5d64-44e8-800b-1be7f95d360c service swift] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:53.980160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179401d-5d64-44e8-800b-1be7f95d360c service swift] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:53.980437 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179401d-5d64-44e8-800b-1be7f95d360c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:53.988357 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179401d-5d64-44e8-800b-1be7f95d360c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:26:53.989976 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179401d-5d64-44e8-800b-1be7f95d360c service swift] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:26:53.998375 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 816/1615] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 23 16:26:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:26:57.328707 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa8fca-6ab4-4c12-8996-9fbbb1993b65 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:26:57.329180 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa8fca-6ab4-4c12-8996-9fbbb1993b65 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:26:57.329281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa8fca-6ab4-4c12-8996-9fbbb1993b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:26:57.348619 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e6fa8fca-6ab4-4c12-8996-9fbbb1993b65 None None] MFA Rules not processed for user `a712cd7ef1e64b93bd2b2a764eb9e742`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:26:57.349820 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e6fa8fca-6ab4-4c12-8996-9fbbb1993b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:26:57.357092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 800/1616] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:26:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:03.995100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=6 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:07.343364 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=6 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:24.546101 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508541fa-57da-41ff-a37e-d8c11604756d None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:24.546674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508541fa-57da-41ff-a37e-d8c11604756d None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:24.546674 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508541fa-57da-41ff-a37e-d8c11604756d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:24.567981 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-508541fa-57da-41ff-a37e-d8c11604756d None None] MFA Rules not processed for user `5fe3a02c2bc247efa354ca5bac39ec4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:24.569223 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-508541fa-57da-41ff-a37e-d8c11604756d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:24.577427 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 817/1617] 10.222.0.16 () {58 vars in 967 bytes} [Tue Aug 23 16:27:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:24.590951 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa8fca-6ab4-4c12-8996-9fbbb1993b65 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:27:24.604383 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa8fca-6ab4-4c12-8996-9fbbb1993b65 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:27:24.609466 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c3340-207e-4f9d-b6fa-51374229058a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fb290911bc4de887d04b71731f76b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:27:24.610118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c3340-207e-4f9d-b6fa-51374229058a service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:24.610404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c3340-207e-4f9d-b6fa-51374229058a service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:24.610680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c3340-207e-4f9d-b6fa-51374229058a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:24.620243 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c3340-207e-4f9d-b6fa-51374229058a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:27:24.621855 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c3340-207e-4f9d-b6fa-51374229058a service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:27:24.631042 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 801/1618] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 23 16:27:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:27:34.562621 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:34.627287 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=6 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:27:42.208800 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a60c61-60be-4005-bcb2-4dd5d62a293e None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:27:42.209268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a60c61-60be-4005-bcb2-4dd5d62a293e None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:27:42.209388 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a60c61-60be-4005-bcb2-4dd5d62a293e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:27:42.229644 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-38a60c61-60be-4005-bcb2-4dd5d62a293e None None] MFA Rules not processed for user `a712cd7ef1e64b93bd2b2a764eb9e742`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:27:42.230908 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-38a60c61-60be-4005-bcb2-4dd5d62a293e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:27:42.237870 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 818/1619] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:27:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:27:52.223985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=3 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:00.364935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c3340-207e-4f9d-b6fa-51374229058a service swift] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:00.374115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c3340-207e-4f9d-b6fa-51374229058a service swift] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:00.377606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9441a2d-1b5d-4f61-afe5-0a143bf864c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:00.378242 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9441a2d-1b5d-4f61-afe5-0a143bf864c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:00.378522 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9441a2d-1b5d-4f61-afe5-0a143bf864c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:00.378793 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9441a2d-1b5d-4f61-afe5-0a143bf864c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:00.388098 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9441a2d-1b5d-4f61-afe5-0a143bf864c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:00.389502 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9441a2d-1b5d-4f61-afe5-0a143bf864c0 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:00.399531 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 802/1620] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:06.981609 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a60c61-60be-4005-bcb2-4dd5d62a293e None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:28:06.994833 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a60c61-60be-4005-bcb2-4dd5d62a293e None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:28:06.999773 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a781a-0fe5-4c2e-b24c-db6c3aa5961e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd1309c315e49eea6af4691d14c3e90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:28:07.000370 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a781a-0fe5-4c2e-b24c-db6c3aa5961e service placement] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:28:07.000652 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a781a-0fe5-4c2e-b24c-db6c3aa5961e service placement] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:28:07.000926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a781a-0fe5-4c2e-b24c-db6c3aa5961e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:28:07.009816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a781a-0fe5-4c2e-b24c-db6c3aa5961e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:28:07.011465 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a781a-0fe5-4c2e-b24c-db6c3aa5961e service placement] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:28:07.020903 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 819/1621] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:28:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:28:10.394537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=6 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:28:17.017014 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=6 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:03.197133 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88d723-c981-43d5-a9e1-b599b5f6cdd9 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:03.198191 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88d723-c981-43d5-a9e1-b599b5f6cdd9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:03.198657 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88d723-c981-43d5-a9e1-b599b5f6cdd9 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:03.201133 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 803/1622] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 23 16:29:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:29:03.206617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cdbff-eb45-4e31-b0d4-d53892535acd None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:03.207108 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cdbff-eb45-4e31-b0d4-d53892535acd None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:03.207426 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cdbff-eb45-4e31-b0d4-d53892535acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:03.232999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-ff7cdbff-eb45-4e31-b0d4-d53892535acd None None] MFA Rules not processed for user `767ca33ca8e244f8a0cc773e3b6abefb`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:29:03.234538 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ff7cdbff-eb45-4e31-b0d4-d53892535acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:03.246134 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 820/1623] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 23 16:29:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:29:03.259134 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88d723-c981-43d5-a9e1-b599b5f6cdd9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:29:03.280302 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88d723-c981-43d5-a9e1-b599b5f6cdd9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:29:03.288667 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98e201-7c7f-4e9f-9079-6edd3a8b38c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:29:03.289467 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98e201-7c7f-4e9f-9079-6edd3a8b38c4 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:03.289788 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98e201-7c7f-4e9f-9079-6edd3a8b38c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:03.290345 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98e201-7c7f-4e9f-9079-6edd3a8b38c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:03.303962 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98e201-7c7f-4e9f-9079-6edd3a8b38c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:29:03.306266 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98e201-7c7f-4e9f-9079-6edd3a8b38c4 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:29:03.320632 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 804/1624] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:29:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:29:09.662268 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef1f80-6671-4088-802a-236b6bee54ca None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:09.662735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef1f80-6671-4088-802a-236b6bee54ca None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:09.662842 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef1f80-6671-4088-802a-236b6bee54ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:09.682477 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-2aef1f80-6671-4088-802a-236b6bee54ca None None] MFA Rules not processed for user `5fe3a02c2bc247efa354ca5bac39ec4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:29:09.683731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-2aef1f80-6671-4088-802a-236b6bee54ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:09.691230 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 821/1625] 10.222.0.16 () {58 vars in 967 bytes} [Tue Aug 23 16:29:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:29:09.747317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98e201-7c7f-4e9f-9079-6edd3a8b38c4 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:29:09.760449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98e201-7c7f-4e9f-9079-6edd3a8b38c4 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:29:09.766294 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b0c64-2ce3-403f-b006-6dc0b2d80348 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fb290911bc4de887d04b71731f76b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:29:09.766970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b0c64-2ce3-403f-b006-6dc0b2d80348 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:09.767316 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b0c64-2ce3-403f-b006-6dc0b2d80348 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:09.767654 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b0c64-2ce3-403f-b006-6dc0b2d80348 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:09.776668 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b0c64-2ce3-403f-b006-6dc0b2d80348 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:29:09.778711 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b0c64-2ce3-403f-b006-6dc0b2d80348 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:29:09.786975 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 805/1626] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 23 16:29:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:29:10.266932 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad238f8d-cecb-44b4-ada1-d4c06c1233d4 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:10.267296 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad238f8d-cecb-44b4-ada1-d4c06c1233d4 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:10.267594 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad238f8d-cecb-44b4-ada1-d4c06c1233d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:10.289060 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-ad238f8d-cecb-44b4-ada1-d4c06c1233d4 None None] MFA Rules not processed for user `5fe3a02c2bc247efa354ca5bac39ec4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:29:10.290458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-ad238f8d-cecb-44b4-ada1-d4c06c1233d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:10.299460 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 822/1627] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 23 16:29:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:29:10.312416 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b0c64-2ce3-403f-b006-6dc0b2d80348 service swift] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:29:10.324899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b0c64-2ce3-403f-b006-6dc0b2d80348 service swift] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:29:10.330629 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac442b6-57e8-4814-bcac-71dbe266e831 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fb290911bc4de887d04b71731f76b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:29:10.331301 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac442b6-57e8-4814-bcac-71dbe266e831 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:10.331628 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac442b6-57e8-4814-bcac-71dbe266e831 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:10.331909 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac442b6-57e8-4814-bcac-71dbe266e831 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:10.341684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac442b6-57e8-4814-bcac-71dbe266e831 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:29:10.343514 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac442b6-57e8-4814-bcac-71dbe266e831 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:29:10.352891 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 806/1628] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 23 16:29:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:29:18.771078 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e4ef4-9ebf-4ae2-ab70-43d3ef7f945c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:18.771593 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e4ef4-9ebf-4ae2-ab70-43d3ef7f945c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:18.771684 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e4ef4-9ebf-4ae2-ab70-43d3ef7f945c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:18.790481 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-be6e4ef4-9ebf-4ae2-ab70-43d3ef7f945c None None] MFA Rules not processed for user `9ac8d81f40714532a4b61e2d3bb0e729`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:29:18.791688 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-be6e4ef4-9ebf-4ae2-ab70-43d3ef7f945c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:18.799292 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 823/1629] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:29:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:29:20.348930 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=18 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:21.673441 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bc079-e7cf-45f7-ba82-4d3318e4edfd None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:21.674015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bc079-e7cf-45f7-ba82-4d3318e4edfd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:21.674015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bc079-e7cf-45f7-ba82-4d3318e4edfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:21.693731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8c3bc079-e7cf-45f7-ba82-4d3318e4edfd None None] MFA Rules not processed for user `5fe3a02c2bc247efa354ca5bac39ec4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:29:21.694991 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8c3bc079-e7cf-45f7-ba82-4d3318e4edfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:29:21.702501 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 807/1630] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 23 16:29:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:29:21.715643 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e4ef4-9ebf-4ae2-ab70-43d3ef7f945c None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:29:21.727381 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e4ef4-9ebf-4ae2-ab70-43d3ef7f945c None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:29:21.733432 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31a053-cfb2-48c3-be97-d23c90c28cd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fb290911bc4de887d04b71731f76b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:29:21.734175 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31a053-cfb2-48c3-be97-d23c90c28cd2 service swift] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:21.734351 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31a053-cfb2-48c3-be97-d23c90c28cd2 service swift] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:21.734679 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31a053-cfb2-48c3-be97-d23c90c28cd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:21.742943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31a053-cfb2-48c3-be97-d23c90c28cd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:29:21.744549 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31a053-cfb2-48c3-be97-d23c90c28cd2 service swift] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:29:21.754387 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 824/1631] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 23 16:29:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:29:31.688739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:31.750438 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=18 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:29:59.604344 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bc079-e7cf-45f7-ba82-4d3318e4edfd None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:29:59.617278 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bc079-e7cf-45f7-ba82-4d3318e4edfd None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:29:59.623452 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48edc7-7399-4b19-a718-3fb954e09e35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:29:59.624057 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48edc7-7399-4b19-a718-3fb954e09e35 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:29:59.624340 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48edc7-7399-4b19-a718-3fb954e09e35 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:29:59.624616 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48edc7-7399-4b19-a718-3fb954e09e35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:29:59.632295 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48edc7-7399-4b19-a718-3fb954e09e35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:29:59.633871 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48edc7-7399-4b19-a718-3fb954e09e35 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:29:59.643405 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 808/1632] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:29:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:30:03.509919 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7f51f-78e6-4c89-a3d4-cbe91b4a7ef3 None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:03.510500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7f51f-78e6-4c89-a3d4-cbe91b4a7ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:03.510500 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7f51f-78e6-4c89-a3d4-cbe91b4a7ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:03.531796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-a9c7f51f-78e6-4c89-a3d4-cbe91b4a7ef3 None None] MFA Rules not processed for user `a712cd7ef1e64b93bd2b2a764eb9e742`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:30:03.533424 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a9c7f51f-78e6-4c89-a3d4-cbe91b4a7ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:30:03.540611 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 825/1633] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:30:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:30:09.009458 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48edc7-7399-4b19-a718-3fb954e09e35 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:30:09.019417 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48edc7-7399-4b19-a718-3fb954e09e35 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:30:09.023123 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83efa838-3ebf-4186-a688-5c89effabb59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:30:09.023967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83efa838-3ebf-4186-a688-5c89effabb59 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:09.024246 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83efa838-3ebf-4186-a688-5c89effabb59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:09.024517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83efa838-3ebf-4186-a688-5c89effabb59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:09.035548 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83efa838-3ebf-4186-a688-5c89effabb59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:30:09.036955 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83efa838-3ebf-4186-a688-5c89effabb59 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:30:09.048157 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 809/1634] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:30:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:30:10.227045 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7f51f-78e6-4c89-a3d4-cbe91b4a7ef3 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:30:10.236772 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7f51f-78e6-4c89-a3d4-cbe91b4a7ef3 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:30:10.240233 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5a657-189d-4ff9-b849-9d4b5533ac5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:30:10.240820 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5a657-189d-4ff9-b849-9d4b5533ac5f service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:10.241096 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5a657-189d-4ff9-b849-9d4b5533ac5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:10.241366 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5a657-189d-4ff9-b849-9d4b5533ac5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:10.252402 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5a657-189d-4ff9-b849-9d4b5533ac5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:30:10.253985 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5a657-189d-4ff9-b849-9d4b5533ac5f service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:30:10.265309 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 826/1635] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:30:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:30:16.880869 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83efa838-3ebf-4186-a688-5c89effabb59 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:30:16.894742 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83efa838-3ebf-4186-a688-5c89effabb59 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:30:16.900875 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029a80e-3672-45b7-96c7-66776b1e3273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:30:16.901562 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029a80e-3672-45b7-96c7-66776b1e3273 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:16.901876 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029a80e-3672-45b7-96c7-66776b1e3273 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:16.902215 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029a80e-3672-45b7-96c7-66776b1e3273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:16.910896 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029a80e-3672-45b7-96c7-66776b1e3273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:30:16.912618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029a80e-3672-45b7-96c7-66776b1e3273 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:30:16.922115 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 810/1636] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:30:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:30:20.259967 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=9 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:30:22.962560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5a657-189d-4ff9-b849-9d4b5533ac5f service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:30:22.974521 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5a657-189d-4ff9-b849-9d4b5533ac5f service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:30:22.980072 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34135eb-523c-47ce-be54-a786595bb3b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:30:22.980677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34135eb-523c-47ce-be54-a786595bb3b7 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:22.980959 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34135eb-523c-47ce-be54-a786595bb3b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:22.981808 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34135eb-523c-47ce-be54-a786595bb3b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:22.991509 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34135eb-523c-47ce-be54-a786595bb3b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:30:22.993097 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34135eb-523c-47ce-be54-a786595bb3b7 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:30:23.003861 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 827/1637] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:30:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:30:23.078184 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029a80e-3672-45b7-96c7-66776b1e3273 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:30:23.082680 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=19 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:30:23.088823 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029a80e-3672-45b7-96c7-66776b1e3273 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:30:23.093743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf4be4-9b36-425d-a68e-7b2b2784f79f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:30:23.094382 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf4be4-9b36-425d-a68e-7b2b2784f79f service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:30:23.094693 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf4be4-9b36-425d-a68e-7b2b2784f79f service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:30:23.094998 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf4be4-9b36-425d-a68e-7b2b2784f79f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:30:23.102376 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf4be4-9b36-425d-a68e-7b2b2784f79f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:30:23.103772 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf4be4-9b36-425d-a68e-7b2b2784f79f service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:30:23.112591 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 811/1638] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:30:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:30:32.999618 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=6 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:30:33.109051 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:31:12.809669 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3bbba-4937-421c-8397-5807663f57ef None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:31:12.810171 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3bbba-4937-421c-8397-5807663f57ef None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:31:12.810276 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3bbba-4937-421c-8397-5807663f57ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:31:12.829505 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-00a3bbba-4937-421c-8397-5807663f57ef None None] MFA Rules not processed for user `5fe3a02c2bc247efa354ca5bac39ec4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:31:12.830749 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-00a3bbba-4937-421c-8397-5807663f57ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:31:12.838718 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 828/1639] 10.222.0.16 () {58 vars in 967 bytes} [Tue Aug 23 16:31:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 16:31:12.878971 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf4be4-9b36-425d-a68e-7b2b2784f79f service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:31:12.892209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf4be4-9b36-425d-a68e-7b2b2784f79f service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:31:12.899363 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5cfdc1-1528-4b6c-8a34-0fd9a1773ef9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fb290911bc4de887d04b71731f76b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:31:12.899968 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cfdc1-1528-4b6c-8a34-0fd9a1773ef9 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:31:12.900252 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cfdc1-1528-4b6c-8a34-0fd9a1773ef9 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:31:12.900531 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5cfdc1-1528-4b6c-8a34-0fd9a1773ef9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:31:12.908709 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5cfdc1-1528-4b6c-8a34-0fd9a1773ef9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:31:12.910333 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5cfdc1-1528-4b6c-8a34-0fd9a1773ef9 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:31:12.920403 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 812/1640] 10.222.0.16 () {60 vars in 1384 bytes} [Tue Aug 23 16:31:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 16:31:13.279076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3bbba-4937-421c-8397-5807663f57ef None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:31:13.288552 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3bbba-4937-421c-8397-5807663f57ef None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:31:13.292038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b6cae-9940-4df4-b6b9-a3f25bdc1007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:31:13.292627 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b6cae-9940-4df4-b6b9-a3f25bdc1007 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:31:13.292904 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b6cae-9940-4df4-b6b9-a3f25bdc1007 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:31:13.293173 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b6cae-9940-4df4-b6b9-a3f25bdc1007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:31:13.354236 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b6cae-9940-4df4-b6b9-a3f25bdc1007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:31:13.355672 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b6cae-9940-4df4-b6b9-a3f25bdc1007 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:31:13.365943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 829/1641] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:31:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:31:16.673167 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b009b-f695-45d7-b481-faafa9b83c47 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:31:16.673663 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b009b-f695-45d7-b481-faafa9b83c47 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:31:16.673838 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b009b-f695-45d7-b481-faafa9b83c47 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:31:16.675304 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 813/1642] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 23 16:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:31:16.680518 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f545b3-6211-4d85-b5cf-68b48799b81c None None] REQUEST_METHOD: `POST` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:31:16.680975 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f545b3-6211-4d85-b5cf-68b48799b81c None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:31:16.681095 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f545b3-6211-4d85-b5cf-68b48799b81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:31:16.701346 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.auth.core [None req-a9f545b3-6211-4d85-b5cf-68b48799b81c None None] MFA Rules not processed for user `9cd1309c315e49eea6af4691d14c3e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81604) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:31:16.702608 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-a9f545b3-6211-4d85-b5cf-68b48799b81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:31:16.712213 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 830/1643] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 23 16:31:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:31:16.725359 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b009b-f695-45d7-b481-faafa9b83c47 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:31:16.740737 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b009b-f695-45d7-b481-faafa9b83c47 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:31:16.746595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d7190-9985-4391-9e13-2ccd47f67771 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd1309c315e49eea6af4691d14c3e90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:31:16.747453 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d7190-9985-4391-9e13-2ccd47f67771 service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:31:16.747892 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d7190-9985-4391-9e13-2ccd47f67771 service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:31:16.748166 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d7190-9985-4391-9e13-2ccd47f67771 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:31:16.758253 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d7190-9985-4391-9e13-2ccd47f67771 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:31:16.759923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d7190-9985-4391-9e13-2ccd47f67771 service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:31:16.770596 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 814/1644] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:31:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:31:19.909870 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1b75f-0bcf-4881-8c81-7088a0509b59 None None] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:31:19.910992 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1b75f-0bcf-4881-8c81-7088a0509b59 None None] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:31:19.911317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1b75f-0bcf-4881-8c81-7088a0509b59 None None] PATH_INFO: `/` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:31:19.912743 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 831/1645] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 23 16:31:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 16:31:19.923238 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1336e8b-4029-4c1d-bda5-e15050482e68 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:31:19.923677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1336e8b-4029-4c1d-bda5-e15050482e68 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:31:19.923798 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1336e8b-4029-4c1d-bda5-e15050482e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:31:19.943695 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e1336e8b-4029-4c1d-bda5-e15050482e68 None None] MFA Rules not processed for user `9cd1309c315e49eea6af4691d14c3e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:31:19.944935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e1336e8b-4029-4c1d-bda5-e15050482e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:31:19.953628 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 815/1646] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Aug 23 16:31:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:31:19.965572 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1b75f-0bcf-4881-8c81-7088a0509b59 None None] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:31:19.979905 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1b75f-0bcf-4881-8c81-7088a0509b59 None None] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:31:19.985066 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f136a-bb88-42ec-8c00-d0830e7f98d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd1309c315e49eea6af4691d14c3e90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:31:19.985685 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f136a-bb88-42ec-8c00-d0830e7f98d0 service placement] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:31:19.985972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f136a-bb88-42ec-8c00-d0830e7f98d0 service placement] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:31:19.986281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f136a-bb88-42ec-8c00-d0830e7f98d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:31:19.987850 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1336e8b-4029-4c1d-bda5-e15050482e68 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:31:19.996187 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f136a-bb88-42ec-8c00-d0830e7f98d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:31:19.997970 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f136a-bb88-42ec-8c00-d0830e7f98d0 service placement] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:31:20.000972 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1336e8b-4029-4c1d-bda5-e15050482e68 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:31:20.006396 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698aa4c-42c6-421c-a9e6-b2afebbf123e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:31:20.007038 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698aa4c-42c6-421c-a9e6-b2afebbf123e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:31:20.007319 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698aa4c-42c6-421c-a9e6-b2afebbf123e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:31:20.007595 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698aa4c-42c6-421c-a9e6-b2afebbf123e admin admin] PATH_INFO: `/v3/users/9ac8d81f40714532a4b61e2d3bb0e729` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:31:20.008821 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698aa4c-42c6-421c-a9e6-b2afebbf123e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ac8d81f40714532a4b61e2d3bb0e729)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:31:20.009943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: WARNING py.warnings [None req-e698aa4c-42c6-421c-a9e6-b2afebbf123e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:31:20.009943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: warnings.warn(msg) Aug 23 16:31:20.009943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: Aug 23 16:31:20.010337 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 832/1647] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:31:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:31:20.011337 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e698aa4c-42c6-421c-a9e6-b2afebbf123e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:31:20.074931 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e698aa4c-42c6-421c-a9e6-b2afebbf123e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ac8d81f40714532a4b61e2d3bb0e729'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:31:20.082490 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e698aa4c-42c6-421c-a9e6-b2afebbf123e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ac8d81f40714532a4b61e2d3bb0e729'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:31:20.083398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e698aa4c-42c6-421c-a9e6-b2afebbf123e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ac8d81f40714532a4b61e2d3bb0e729'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:31:20.093731 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e698aa4c-42c6-421c-a9e6-b2afebbf123e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ac8d81f40714532a4b61e2d3bb0e729'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:31:20.112324 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e698aa4c-42c6-421c-a9e6-b2afebbf123e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ac8d81f40714532a4b61e2d3bb0e729'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:31:20.118393 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 816/1648] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 23 16:31:19 2022] DELETE /identity/v3/users/9ac8d81f40714532a4b61e2d3bb0e729 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:31:20.297306 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f136a-bb88-42ec-8c00-d0830e7f98d0 service placement] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:31:20.311941 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f136a-bb88-42ec-8c00-d0830e7f98d0 service placement] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:31:20.369255 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d80e05-a9d2-4794-824e-a09b34ccdd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:31:20.369889 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d80e05-a9d2-4794-824e-a09b34ccdd15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:31:20.370215 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d80e05-a9d2-4794-824e-a09b34ccdd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:31:20.370494 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d80e05-a9d2-4794-824e-a09b34ccdd15 admin admin] PATH_INFO: `/v3/projects/290c50c2cf2743e686aed4516d21176f` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:31:20.371606 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d80e05-a9d2-4794-824e-a09b34ccdd15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=290c50c2cf2743e686aed4516d21176f)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:31:20.372652 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: WARNING py.warnings [None req-20d80e05-a9d2-4794-824e-a09b34ccdd15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:31:20.372652 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: warnings.warn(msg) Aug 23 16:31:20.372652 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: Aug 23 16:31:20.373858 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d80e05-a9d2-4794-824e-a09b34ccdd15 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:31:20.430832 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-20d80e05-a9d2-4794-824e-a09b34ccdd15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '290c50c2cf2743e686aed4516d21176f', 'request_id': 'req-20d80e05-a9d2-4794-824e-a09b34ccdd15'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:31:20.444281 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-20d80e05-a9d2-4794-824e-a09b34ccdd15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '290c50c2cf2743e686aed4516d21176f', 'request_id': 'req-20d80e05-a9d2-4794-824e-a09b34ccdd15'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:31:20.451461 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-20d80e05-a9d2-4794-824e-a09b34ccdd15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '290c50c2cf2743e686aed4516d21176f', 'request_id': 'req-20d80e05-a9d2-4794-824e-a09b34ccdd15'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:31:20.459341 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:31:20.465025 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-20d80e05-a9d2-4794-824e-a09b34ccdd15 admin admin] The token cache is being invalidate because project 290c50c2cf2743e686aed4516d21176f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:31:20.465514 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-20d80e05-a9d2-4794-824e-a09b34ccdd15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:31:20.466576 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-20d80e05-a9d2-4794-824e-a09b34ccdd15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:31:20.468201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 833/1649] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 23 16:31:20 2022] DELETE /identity/v3/projects/290c50c2cf2743e686aed4516d21176f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:31:20.472214 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698aa4c-42c6-421c-a9e6-b2afebbf123e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:31:20.474248 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e698aa4c-42c6-421c-a9e6-b2afebbf123e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:31:20.487400 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698aa4c-42c6-421c-a9e6-b2afebbf123e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:31:20.543480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce863b-5989-4522-a54e-6a0947058299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:31:20.544112 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce863b-5989-4522-a54e-6a0947058299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:31:20.544398 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce863b-5989-4522-a54e-6a0947058299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:31:20.544677 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce863b-5989-4522-a54e-6a0947058299 admin admin] PATH_INFO: `/v3/users/f47cea9ac35c49a4b2bb4a2037256c53` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:31:20.545805 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce863b-5989-4522-a54e-6a0947058299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f47cea9ac35c49a4b2bb4a2037256c53)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:31:20.547763 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce863b-5989-4522-a54e-6a0947058299 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:31:20.592191 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:31:20.598782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dfce863b-5989-4522-a54e-6a0947058299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f47cea9ac35c49a4b2bb4a2037256c53'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:31:20.606612 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dfce863b-5989-4522-a54e-6a0947058299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f47cea9ac35c49a4b2bb4a2037256c53'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:31:20.607317 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dfce863b-5989-4522-a54e-6a0947058299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f47cea9ac35c49a4b2bb4a2037256c53'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:31:20.614878 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dfce863b-5989-4522-a54e-6a0947058299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f47cea9ac35c49a4b2bb4a2037256c53'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:31:20.627591 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dfce863b-5989-4522-a54e-6a0947058299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f47cea9ac35c49a4b2bb4a2037256c53'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:31:20.634639 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 817/1650] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 23 16:31:20 2022] DELETE /identity/v3/users/f47cea9ac35c49a4b2bb4a2037256c53 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:31:20.828888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d80e05-a9d2-4794-824e-a09b34ccdd15 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:31:20.830577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-20d80e05-a9d2-4794-824e-a09b34ccdd15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:31:20.844828 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d80e05-a9d2-4794-824e-a09b34ccdd15 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:31:20.903491 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6df3f-03ef-4d42-abf7-8bdde3280003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:31:20.904125 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6df3f-03ef-4d42-abf7-8bdde3280003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:31:20.904449 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6df3f-03ef-4d42-abf7-8bdde3280003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:31:20.904727 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6df3f-03ef-4d42-abf7-8bdde3280003 admin admin] PATH_INFO: `/v3/projects/ee8ab034c6174ac8bddcb700b2020f17` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:31:20.905830 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6df3f-03ef-4d42-abf7-8bdde3280003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8ab034c6174ac8bddcb700b2020f17)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:31:20.907779 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6df3f-03ef-4d42-abf7-8bdde3280003 admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:31:20.955442 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c4e6df3f-03ef-4d42-abf7-8bdde3280003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8ab034c6174ac8bddcb700b2020f17', 'request_id': 'req-c4e6df3f-03ef-4d42-abf7-8bdde3280003'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:31:20.961785 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c4e6df3f-03ef-4d42-abf7-8bdde3280003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8ab034c6174ac8bddcb700b2020f17', 'request_id': 'req-c4e6df3f-03ef-4d42-abf7-8bdde3280003'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:31:20.969344 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c4e6df3f-03ef-4d42-abf7-8bdde3280003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8ab034c6174ac8bddcb700b2020f17', 'request_id': 'req-c4e6df3f-03ef-4d42-abf7-8bdde3280003'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:31:20.983782 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c4e6df3f-03ef-4d42-abf7-8bdde3280003 admin admin] The token cache is being invalidate because project ee8ab034c6174ac8bddcb700b2020f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81604) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:31:20.984076 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c4e6df3f-03ef-4d42-abf7-8bdde3280003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:31:20.984819 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-c4e6df3f-03ef-4d42-abf7-8bdde3280003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:31:20.986442 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 834/1651] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 23 16:31:20 2022] DELETE /identity/v3/projects/ee8ab034c6174ac8bddcb700b2020f17 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:31:30.630961 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=14,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:31:30.980072 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:32:08.550584 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d95ce-afb8-484a-b211-44bb6da0d879 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:08.551201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d95ce-afb8-484a-b211-44bb6da0d879 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:08.551201 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d95ce-afb8-484a-b211-44bb6da0d879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:08.571508 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f46d95ce-afb8-484a-b211-44bb6da0d879 None None] MFA Rules not processed for user `a712cd7ef1e64b93bd2b2a764eb9e742`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 16:32:08.573033 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f46d95ce-afb8-484a-b211-44bb6da0d879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:08.636226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 818/1652] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 23 16:32:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 16:32:08.983395 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6df3f-03ef-4d42-abf7-8bdde3280003 admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:32:08.985212 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-c4e6df3f-03ef-4d42-abf7-8bdde3280003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:09.065943 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6df3f-03ef-4d42-abf7-8bdde3280003 admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:32:09.070845 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e31cd-341d-4af3-b82f-7db34db3e5c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:32:09.071935 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e31cd-341d-4af3-b82f-7db34db3e5c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:09.072230 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e31cd-341d-4af3-b82f-7db34db3e5c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:09.072477 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e31cd-341d-4af3-b82f-7db34db3e5c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:09.074386 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9b5e31cd-341d-4af3-b82f-7db34db3e5c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:09.085209 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e31cd-341d-4af3-b82f-7db34db3e5c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:32:09.086692 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e31cd-341d-4af3-b82f-7db34db3e5c5 service neutron] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:32:09.095527 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 835/1653] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:32:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:32:10.608839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d95ce-afb8-484a-b211-44bb6da0d879 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:32:10.610560 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f46d95ce-afb8-484a-b211-44bb6da0d879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:10.708152 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d95ce-afb8-484a-b211-44bb6da0d879 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:32:10.716537 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee08ba-fc5d-4e1d-9354-28b38e833a11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd1309c315e49eea6af4691d14c3e90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:32:10.717841 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee08ba-fc5d-4e1d-9354-28b38e833a11 service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:10.718310 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee08ba-fc5d-4e1d-9354-28b38e833a11 service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:10.718736 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee08ba-fc5d-4e1d-9354-28b38e833a11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:10.721388 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b8ee08ba-fc5d-4e1d-9354-28b38e833a11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:10.737821 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee08ba-fc5d-4e1d-9354-28b38e833a11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:32:10.741404 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee08ba-fc5d-4e1d-9354-28b38e833a11 service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:32:10.753940 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 819/1654] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:32:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:32:19.091645 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=26 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:32:20.749558 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=57 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:32:26.965633 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e31cd-341d-4af3-b82f-7db34db3e5c5 service neutron] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:32:26.967776 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-9b5e31cd-341d-4af3-b82f-7db34db3e5c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:27.078927 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e31cd-341d-4af3-b82f-7db34db3e5c5 service neutron] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:32:27.085523 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99201c24-0a54-48ff-90cb-2b91146c7af7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:32:27.086197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99201c24-0a54-48ff-90cb-2b91146c7af7 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:32:27.086483 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99201c24-0a54-48ff-90cb-2b91146c7af7 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:32:27.086760 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99201c24-0a54-48ff-90cb-2b91146c7af7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:32:27.088942 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-99201c24-0a54-48ff-90cb-2b91146c7af7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:32:27.108899 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99201c24-0a54-48ff-90cb-2b91146c7af7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:32:27.111000 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99201c24-0a54-48ff-90cb-2b91146c7af7 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:32:27.123666 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 836/1655] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:32:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:32:37.119006 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=34 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:33:10.967050 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee08ba-fc5d-4e1d-9354-28b38e833a11 service placement] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:33:11.031008 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee08ba-fc5d-4e1d-9354-28b38e833a11 service placement] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:33:11.037134 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faae411-e0d5-42fb-9430-21ea3d5995d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd1309c315e49eea6af4691d14c3e90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:33:11.037844 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faae411-e0d5-42fb-9430-21ea3d5995d0 service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:33:11.038092 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faae411-e0d5-42fb-9430-21ea3d5995d0 service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:33:11.038482 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faae411-e0d5-42fb-9430-21ea3d5995d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:33:11.040796 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3faae411-e0d5-42fb-9430-21ea3d5995d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:33:11.077888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faae411-e0d5-42fb-9430-21ea3d5995d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:33:11.080720 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faae411-e0d5-42fb-9430-21ea3d5995d0 service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:33:11.095939 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 820/1656] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:33:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:33:21.089055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=36 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:10.353183 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99201c24-0a54-48ff-90cb-2b91146c7af7 service nova] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:10.431155 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99201c24-0a54-48ff-90cb-2b91146c7af7 service nova] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:10.437989 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff2597-fa14-4814-8189-d438e8c93d04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '767ca33ca8e244f8a0cc773e3b6abefb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:10.438688 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff2597-fa14-4814-8189-d438e8c93d04 service nova] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:10.439003 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff2597-fa14-4814-8189-d438e8c93d04 service nova] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:10.439283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff2597-fa14-4814-8189-d438e8c93d04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:10.441517 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-19ff2597-fa14-4814-8189-d438e8c93d04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:10.472118 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff2597-fa14-4814-8189-d438e8c93d04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:10.473816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff2597-fa14-4814-8189-d438e8c93d04 service nova] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:10.495197 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 837/1657] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:20.480913 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=35 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:22.575980 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faae411-e0d5-42fb-9430-21ea3d5995d0 service placement] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:22.577585 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3faae411-e0d5-42fb-9430-21ea3d5995d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:22.614739 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faae411-e0d5-42fb-9430-21ea3d5995d0 service placement] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:22.618456 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45377d-600b-40bf-b280-9a3795eb0468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eae00506f75402fbf972a8991ad0a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:22.619056 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45377d-600b-40bf-b280-9a3795eb0468 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:22.619343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45377d-600b-40bf-b280-9a3795eb0468 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:22.619756 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45377d-600b-40bf-b280-9a3795eb0468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:22.621473 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6d45377d-600b-40bf-b280-9a3795eb0468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:22.708413 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45377d-600b-40bf-b280-9a3795eb0468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:22.709757 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45377d-600b-40bf-b280-9a3795eb0468 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:22.729503 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 821/1658] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:34:29.065772 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff2597-fa14-4814-8189-d438e8c93d04 service nova] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:29.067239 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-19ff2597-fa14-4814-8189-d438e8c93d04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:29.091503 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff2597-fa14-4814-8189-d438e8c93d04 service nova] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:29.096889 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f66b00-1c32-4957-a5ed-e19296fa07cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:29.097559 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f66b00-1c32-4957-a5ed-e19296fa07cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:29.097839 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f66b00-1c32-4957-a5ed-e19296fa07cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:29.098150 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f66b00-1c32-4957-a5ed-e19296fa07cd admin admin] PATH_INFO: `/v3/users/a712cd7ef1e64b93bd2b2a764eb9e742` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:29.099312 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f66b00-1c32-4957-a5ed-e19296fa07cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a712cd7ef1e64b93bd2b2a764eb9e742)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:29.101283 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f66b00-1c32-4957-a5ed-e19296fa07cd admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:29.167598 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-74f66b00-1c32-4957-a5ed-e19296fa07cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a712cd7ef1e64b93bd2b2a764eb9e742'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:29.178553 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-74f66b00-1c32-4957-a5ed-e19296fa07cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a712cd7ef1e64b93bd2b2a764eb9e742'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:29.179226 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-74f66b00-1c32-4957-a5ed-e19296fa07cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a712cd7ef1e64b93bd2b2a764eb9e742'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:29.188746 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-74f66b00-1c32-4957-a5ed-e19296fa07cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a712cd7ef1e64b93bd2b2a764eb9e742'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:29.202564 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-74f66b00-1c32-4957-a5ed-e19296fa07cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a712cd7ef1e64b93bd2b2a764eb9e742'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:29.210016 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 838/1659] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 23 16:34:29 2022] DELETE /identity/v3/users/a712cd7ef1e64b93bd2b2a764eb9e742 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:29.408920 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45377d-600b-40bf-b280-9a3795eb0468 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:29.418888 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45377d-600b-40bf-b280-9a3795eb0468 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:29.484302 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b08c39-5c75-4654-8327-a930a1f071f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:29.485055 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b08c39-5c75-4654-8327-a930a1f071f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:29.485237 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b08c39-5c75-4654-8327-a930a1f071f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:29.485502 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b08c39-5c75-4654-8327-a930a1f071f0 admin admin] PATH_INFO: `/v3/projects/477993ef6a5146c1af5ee9e32245fb77` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:29.486705 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b08c39-5c75-4654-8327-a930a1f071f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=477993ef6a5146c1af5ee9e32245fb77)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:29.488617 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b08c39-5c75-4654-8327-a930a1f071f0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:29.539320 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:29.540784 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d5b08c39-5c75-4654-8327-a930a1f071f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '477993ef6a5146c1af5ee9e32245fb77', 'request_id': 'req-d5b08c39-5c75-4654-8327-a930a1f071f0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:29.548277 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d5b08c39-5c75-4654-8327-a930a1f071f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '477993ef6a5146c1af5ee9e32245fb77', 'request_id': 'req-d5b08c39-5c75-4654-8327-a930a1f071f0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:29.554577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d5b08c39-5c75-4654-8327-a930a1f071f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '477993ef6a5146c1af5ee9e32245fb77', 'request_id': 'req-d5b08c39-5c75-4654-8327-a930a1f071f0'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:29.572100 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d5b08c39-5c75-4654-8327-a930a1f071f0 admin admin] The token cache is being invalidate because project 477993ef6a5146c1af5ee9e32245fb77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:34:29.572419 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d5b08c39-5c75-4654-8327-a930a1f071f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:29.573114 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d5b08c39-5c75-4654-8327-a930a1f071f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:29.574870 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 822/1660] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 23 16:34:29 2022] DELETE /identity/v3/projects/477993ef6a5146c1af5ee9e32245fb77 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 16:34:29.579590 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f66b00-1c32-4957-a5ed-e19296fa07cd admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:29.581122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-74f66b00-1c32-4957-a5ed-e19296fa07cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:29.610783 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f66b00-1c32-4957-a5ed-e19296fa07cd admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:29.669977 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc71b8a-ecac-42e1-baf9-1c322047dcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:29.670648 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc71b8a-ecac-42e1-baf9-1c322047dcdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:29.670934 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc71b8a-ecac-42e1-baf9-1c322047dcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:29.671216 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc71b8a-ecac-42e1-baf9-1c322047dcdf admin admin] PATH_INFO: `/v3/users/1632563db2f64674a9e483fcbddd7870` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:29.672343 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc71b8a-ecac-42e1-baf9-1c322047dcdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1632563db2f64674a9e483fcbddd7870)` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:29.674299 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc71b8a-ecac-42e1-baf9-1c322047dcdf admin admin] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:29.728577 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-bdc71b8a-ecac-42e1-baf9-1c322047dcdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1632563db2f64674a9e483fcbddd7870'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:29.737160 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-bdc71b8a-ecac-42e1-baf9-1c322047dcdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1632563db2f64674a9e483fcbddd7870'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:29.737816 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-bdc71b8a-ecac-42e1-baf9-1c322047dcdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1632563db2f64674a9e483fcbddd7870'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:29.744999 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-bdc71b8a-ecac-42e1-baf9-1c322047dcdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1632563db2f64674a9e483fcbddd7870'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:29.753567 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:29.758578 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.notifications [None req-bdc71b8a-ecac-42e1-baf9-1c322047dcdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1632563db2f64674a9e483fcbddd7870'} {{(pid=81604) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:29.766707 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 839/1661] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 23 16:34:29 2022] DELETE /identity/v3/users/1632563db2f64674a9e483fcbddd7870 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:34:29.956068 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b08c39-5c75-4654-8327-a930a1f071f0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:34:29.958015 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d5b08c39-5c75-4654-8327-a930a1f071f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:34:29.978735 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b08c39-5c75-4654-8327-a930a1f071f0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:34:30.055636 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05d663-50af-4e58-bc30-fa5fa6f9c21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '307f76b84605446ea643922d0a93ba9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '062779fbe176490e8964d5f2d8d34b76', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:34:30.056270 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05d663-50af-4e58-bc30-fa5fa6f9c21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:34:30.056555 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05d663-50af-4e58-bc30-fa5fa6f9c21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:34:30.056829 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05d663-50af-4e58-bc30-fa5fa6f9c21b admin admin] PATH_INFO: `/v3/projects/0f22089821c642a68e725df2128ad7e5` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:34:30.057963 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05d663-50af-4e58-bc30-fa5fa6f9c21b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f22089821c642a68e725df2128ad7e5)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:34:30.060480 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc05d663-50af-4e58-bc30-fa5fa6f9c21b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:34:30.107765 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fc05d663-50af-4e58-bc30-fa5fa6f9c21b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f22089821c642a68e725df2128ad7e5', 'request_id': 'req-fc05d663-50af-4e58-bc30-fa5fa6f9c21b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:30.114122 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fc05d663-50af-4e58-bc30-fa5fa6f9c21b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f22089821c642a68e725df2128ad7e5', 'request_id': 'req-fc05d663-50af-4e58-bc30-fa5fa6f9c21b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:30.119641 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fc05d663-50af-4e58-bc30-fa5fa6f9c21b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f22089821c642a68e725df2128ad7e5', 'request_id': 'req-fc05d663-50af-4e58-bc30-fa5fa6f9c21b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:30.133084 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fc05d663-50af-4e58-bc30-fa5fa6f9c21b admin admin] The token cache is being invalidate because project 0f22089821c642a68e725df2128ad7e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 16:34:30.133285 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fc05d663-50af-4e58-bc30-fa5fa6f9c21b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:30.133928 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fc05d663-50af-4e58-bc30-fa5fa6f9c21b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 16:34:30.135508 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 823/1662] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 23 16:34:29 2022] DELETE /identity/v3/projects/0f22089821c642a68e725df2128ad7e5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 16:34:39.770487 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:34:40.129924 dv-osbrick-836056-3-iscsi devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=58,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:38:16.872229 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc71b8a-ecac-42e1-baf9-1c322047dcdf admin admin] Authenticating user token {{(pid=81604) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 16:38:16.874589 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-bdc71b8a-ecac-42e1-baf9-1c322047dcdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:16.991923 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc71b8a-ecac-42e1-baf9-1c322047dcdf admin admin] Validating token access rules against request {{(pid=81604) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 16:38:17.062013 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144ab1f-3834-415e-b034-931c24ad919e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cd1309c315e49eea6af4691d14c3e90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a0439c9dd3406f81e2740fe775782b', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81604) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 16:38:17.062926 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144ab1f-3834-415e-b034-931c24ad919e service placement] REQUEST_METHOD: `GET` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 16:38:17.063332 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144ab1f-3834-415e-b034-931c24ad919e service placement] SCRIPT_NAME: `/identity` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 16:38:17.063729 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144ab1f-3834-415e-b034-931c24ad919e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81604) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 16:38:17.066625 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.fernet_utils [None req-e144ab1f-3834-415e-b034-931c24ad919e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81604) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 16:38:17.082041 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144ab1f-3834-415e-b034-931c24ad919e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 16:38:17.084701 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144ab1f-3834-415e-b034-931c24ad919e service placement] RBAC: Authorization granted {{(pid=81604) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 16:38:17.098284 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: [pid: 81604|app: 0|req: 840/1663] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Aug 23 16:38:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 16:38:27.093694 dv-osbrick-836056-3-iscsi devstack@keystone.service[81604]: DEBUG dbcounter [-] [81604] Writing DB stats keystone:SELECT=58 {{(pid=81604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}